Anka Reuel | @ankareuel.bsky.social (@AnkaReuel) header
Anka Reuel | @ankareuel.bsky.social (@AnkaReuel) profile picture

Incoming Assistant Prof @ Harvard (Public Policy & Computer Science) | CS PhD Candidate @ Stanford | Former Vice-Chair GPAI CoP @ European Commission

Stanford, CA
Joined March 2020
Photo by Anka Reuel | @ankareuel.bsky.social (@AnkaReuel)Photo by Anka Reuel | @ankareuel.bsky.social (@AnkaReuel)Photo by Anka Reuel | @ankareuel.bsky.social (@AnkaReuel)Photo by Anka Reuel | @ankareuel.bsky.social (@AnkaReuel)Photo by Anka Reuel | @ankareuel.bsky.social (@AnkaReuel)Photo by Anka Reuel | @ankareuel.bsky.social (@AnkaReuel)Photo by Anka Reuel | @ankareuel.bsky.social (@AnkaReuel)Photo by Anka Reuel | @ankareuel.bsky.social (@AnkaReuel)Photo by Anka Reuel | @ankareuel.bsky.social (@AnkaReuel)
Now’s prob a good time to mention that I’ll start as an Assistant Professor with appointments at @Kennedy_School and @HarvardEngineer in 2027, working on… AI evals! My lab will also work on monitorability, incident analysis, and verification to advance technical AI governance 1/
51
51
12
720
143,284
Anka Reuel | @ankareuel.bsky.social retweeted
Learn to build evals, folks! You're not really doing recursive self-improvement (RSI) if you are not doing evals. And don't tell me your agents are generating the evals for you. They are pretty bad at it. I have found it really interesting and useful to give agents a concrete way to measure results and stay on track with a long-term goal. It's easier to hill climb when things are clearly measured and well defined. Probably one of the most important skills anyone in the space can have today. It doesn't matter how many agents and intelligence you throw at a problem; you are not going too far without proper evals.
55
17
3
263
14,501
Anka Reuel | @ankareuel.bsky.social retweeted
Really good list
I often get asked what I read to keep up with everything happening in AI governance. Substack is one of my go-to places for more in-depth commentary. They just launched lists today so I made one with all my fav AI governance Substacks: ankareuel.substack.com/lists… Please suggest additions in the comments if you have one that you love and that’s not on the list yet!
1
1
3
1,304
I often get asked what I read to keep up with everything happening in AI governance. Substack is one of my go-to places for more in-depth commentary. They just launched lists today so I made one with all my fav AI governance Substacks: ankareuel.substack.com/lists… Please suggest additions in the comments if you have one that you love and that’s not on the list yet!
2
1
1
50
3,385
REPORT UNCERTAINTY IF YOU WANT TO CLAIM YOU‘RE BETTER THAN THE COMPETITION. AI eval scores can vary substantially run-by-run, with different scaffolds, etc. Claiming you’re „better than“ without uncertainty estimates is ridiculous and marketing, not science. This goes for @AnthropicAI @OpenAI @AIatMeta, too, not just @GoogleDeepMind.
Introducing Gemini 4 Carbon, it's a big jump over Argon which we released just 2 weeks ago. Gemini 4 Carbon is SOTA on cyber, long horizon tasks, ranks #1 on Artificial Analysis V5, significantly improves on usability in domains like coding, and is more aligned.
5
2
3
83
11,704
Anka Reuel | @ankareuel.bsky.social retweeted
Even professional analysts defer overwhelmingly to their AI assistants, yet seem unaware of the degree of influence…to the point of repeating the AI’s own arguments verbatim as their own. Work like this is super important right now (and concerning):
New Anthropic research: How AI agents shape experts' judgment calls When experts delegate work to an agent, do they still make the key decisions? We tested this in a randomized trial with 50 professional data analysts.
4
6
1
49
5,167
One of the best-curated events I’ve attended this year! Everyone I met had thoughtful, sensible perspectives on where AI evaluations and the ecosystem need to go. Left with new friends, collaborations, and even a potential funder for my new lab that’s gonna be working on evals! Big thanks to @typewriters @SnorkelAI @arcprize for bringing such a great crowd together 🫶
We co-hosted a dinner in SF with @SnorkelAI and our favorite people building and leveraging evals After years of hearing about how creating AI standards will lead to a race to the top, I've been confounded that experts on the ground developing, deploying and maintaining benchmarks (from the private sector + nonprofits) were not talking to one another or collaborating on frameworks to help scale the evaluator ecosystem Without shared knowledge around how to create these measurement tools, we'll never know if AI systems are meeting the standards The dinner came after @SnorkelAI announced their $30M open benchmarking grant program and before the first @arcprize Research Summit in Boston This area of measurement science is new and we'll only get to our desired end state by working together (example on the state of the world re: third party AI auditing - some folks on the nonprofit side had not heard of Snorkel, which just raised a $350M Series E and their business requires shipping quality benchmarks across domains). There's a lot of we can learn from one another Thanks to @ValsAI , @EpochAIResearch , @METR_Evals , @Harvard , @GoogleDeepMind, @midjourney, @nvidia, @IFP, @NIST, @a16z, @LaudeInstitute, @GriffinCMU, @OpenAI, @SemiAnalysis_ , @Meta, @MLCommons, @MTSlive and @alice_dot_io for attending, and @arcprize for lifting all boats
3
3
1
28
2,855
Anka Reuel | @ankareuel.bsky.social retweeted
I wrote a quick new post on "Digital Hygiene". Basically there are some no-brainer decisions you can make in your life to dramatically improve the privacy and security of your computing and this post goes over some of them. Blog post link in the reply, but copy pasting below too. Every now and then I get reminded about the vast fraud apparatus of the internet, re-invigorating my pursuit of basic digital hygiene around privacy/security of day to day computing. The sketchiness starts with major tech companies who are incentivized to build comprehensive profiles of you, to monetize it directly for advertising, or sell it off to professional data broker companies who further enrich, de-anonymize, cross-reference and resell it further. Inevitable and regular data breaches eventually runoff and collect your information into dark web archives, feeding into a whole underground spammer / scammer industry of hacks, phishing, ransomware, credit card fraud, identity theft, etc. This guide is a collection of the most basic digital hygiene tips, starting with the most basic to a bit more niche. Password manager. Your passwords are your "first factor", i.e. "something you know". Do not be a noob and mint new, unique, hard passwords for every website or service that you sign up with. Combine this with a browser extension to create and Autofill them super fast. For example, I use and like 1Password. This prevents your passwords from 1) being easy to guess or crack, and 2) leaking one single time, and opening doors to many other services. In return, we now have a central location for all your 1st factors (passwords), so we must make sure to secure it thoroughly, which brings us to... Hardware security key. The most critical services in your life (e.g. Google, or 1Password) must be additionally secured with a "2nd factor", i.e. "something you have". An attacker would have to be in possession of both factors to gain access to these services. The most common 2nd factor implemented by many services is a phone number, the idea being that you get a text message with a pin code to enter in addition to your password. Clearly, this is much better than having no 2nd factor at all, but the use of a phone number is known to be extremely insecure due to the SIM swap attack. Basically, it turns out to be surprisingly easy for an attacker to call your phone company, pretend they are you, and get them to switch your phone number over to a new phone that they control. I know this sounds totally crazy but it is true, and I have many friends who are victims of this attack. Therefore, purchase and set up hardware security keys - the industrial strength protection standard. In particular, I like and use YubiKey. These devices generate and store a private key on the device secure element itself, so the private key is never materialized on a suspiciously general purpose computing device like your laptop. Once you set these up, an attacker will not only need to know your password, but have physical possession of your security key to log in to a service. Your risk of getting pwned has just decreased by about 1000X. Purchase and set up 2-3 keys and store them in different physical locations to prevent lockout should you physically lose one of the keys. The security keys support a few authentication methods. Look for "U2F" in the 2nd factor settings of your service as the strongest protection. E.g. Google and 1Password support it. Fallback on "TOTP" if you have to, and note that your YubiKeys can store TOTP private keys, so you can use the YubiKey Authenticator app to access them easily through NFC by touching your key to the phone to get your pin when logging in. This is significantly better than storing TOTP private keys on other (software) authenticator apps, because again you should not trust general purpose computing devices. It is beyond the scope of this post to go into full detail, but basically I strongly recommend the use of 2-3 YubiKeys to dramatically strengthen your digital security. Biometrics. Biometrics are the third common authentication factor ("something you are"). E.g. if you're on iOS I recommend setting up FaceID basically everywhere, e.g. to access the 1Password app and such. Security questions. Dinosaur businesses are obsessed with the idea of security questions like "what is your mother's maidan name?", and force you to set them up from time to time. Clearly, these are in the category of "something you know" so they are basically passwords, but conveniently for scammers, they are easy to research out on the open internet and you should refuse any prompts to participate in this ridiculous "security" exercise. Instead, treat security questions like passwords, generate random answers to random questions, and store them in your 1Password along with your passwords. Disk encryption. Always ensure that your computers use disk encryption. For example, on Macs this total no-brainer feature is called "File Vault". This feature ensures that if your computer gets stolen, an attacker won't be able to get the hard disk and go to town on all your data. Internet of Things. More like @internetofshit. Whenever possible, avoid "smart" devices, which are essentially incredibly insecure, internet-connected computers that gather tons of data, get hacked all the time, and that people willingly place into their homes. These things have microphones, and they routinely send data back to the mothership for analytics and to "improve customer experience" lol ok. As an example, in my younger and naive years I once purchased a CO2 monitor from China that demanded to know everything about me and my precise physical location before it would tell me the amount of CO2 in my room. These devices are a huge and very common attack surface on your privacy and security and should be avoided. Messaging. I recommend Signal instead of text messages because it end-to-end encrypts all your communications. In addition, it does not store metadata like many other apps do (e.g. iMessage, WhatsApp). Turn on disappearing messages (e.g. 90 days default is good). In my experience they are an information vulnerability with no significant upside. Browser. I recommend Brave browser, which is a privacy-first browser based on Chromium. That means that basically all Chrome extensions work out of the box and the browser feels like Chrome, but without Google having front row seats to your entire digital life. Search engine. I recommend Brave search, which you can set up as your default in the browser settings. Brave Search is a privacy-first search engine with its own index, unlike e.g. Duck Duck Go which basically a nice skin for Bing, and is forced into weird partnerships with Microsoft that compromise user privacy. As with all services on this list, I pay $3/mo for Brave Premium because I prefer to be the customer, not the product in my digital life. I find that empirically, about 95% of my search engine queries are super simple website lookups, with the search engine basically acting as a tiny DNS. And if you're not finding what you're looking for, fallback to Google by just prepending "!g" to your search query, which will redirect it to Google. Credit cards. Mint new, unique credit cards per merchant. There is no need to use one credit card on many services. This allows them to "link up" your purchasing across different services, and additionally it opens you up to credit card fraud because the services might leak your credit card number. I like and use privacy dot com to mint new credit cards for every single transaction or merchant. You get a nice interface for all your spending and notifications for each swipe. You can also set limits on each credit card (e.g. $50/month etc.), which dramatically decreases the risk of being charged more than you expect. Additionally, with a privacy dot com card you get to enter totally random information for your name and address when filling out billing information. This is huge, because there is simply no need and totally crazy that random internet merchants should be given your physical address. Which brings me to... Address. There is no need to give out your physical address to the majority of random services and merchants on the internet. Use a virtual mail service. I currently use Earth Class Mail but tbh I'm a bit embarrassed by that and I'm looking to switch to Virtual Post Mail due to its much strong commitments to privacy, security, and its ownership structure and reputation. In any case, you get an address you can give out, they receive your mail, they scan it and digitize it, they have an app for you to quickly see it, and you can decide what to do with it (e.g. shred, forward, etc.). Not only do you gain security and privacy but also quite a bit of convenience. Email. I still use gmail just due to sheer convenience, but I've started to partially use Proton Mail as well. And while we're on email, a few more thoughts. Never click on any link inside any email you receive. Email addresses are extremely easy to spoof and you can never be guaranteed that the email you got is a phishing email from a scammer. Instead, I manually navigate to any service of interest and log in from there. In addition, disable image loading by default in your email's settings. If you get an email that requires you to see images, you can click on "show images" to see them and it's not a big deal at all. This is important because many services use embedded images to track you - they hide information inside the image URL you get, so when your email client loads the image, they can see that you opened the email. There's just no need for that. Additionally, confusing images are one way scammers hide information to avoid being filtered by email servers as scam / spam. VPN. If you wish to hide your IP/location to services, you can do so via VPN indirection. I recommend Mullvad VPN. I keep VPN off by default, but enable it selectively when I'm dealing with services I trust less and want more protection from. DNS-based blocker. You can block ads by blocking entire domains at the DNS level. I like and use NextDNS, which blocks all kinds of ads and trackers. For more advanced users who like to tinker, pi-hole is the physical alternative. Network monitor. I like and use The Little Snitch, which I have installed and running on my MacBook. This lets you see which apps are communicating, how much data and when, so you can keep track of what apps on your computer "call home" and how often. Any app that communicates too much is sus, and should potentially be uninstalled if you don't expect the traffic. I just want to live a secure digital life and establish harmonious relationships with products and services that leak only the necessary information. And I wish to pay for the software I use so that incentives are aligned and so that I am the customer. This is not trivial, but it is possible to approach with some determination and discipline. Finally, what's not on the list. I mostly still use Gmail + Gsuite because it's just too convenient and pervasive. I also use 𝕏 instead of something exotic (e.g. Mastodon), trading off sovereignty for convenience. I don't use a VoIP burner phone service (e.g. MySudo) but I am interested in it. I don't really mint new/unique email addresses but I want to. The journey continues. Let me know if there are other digital hygiene tips and tricks that should be on this list. Link to blog post version in the reply, on my brand new Bear ʕ•ᴥ•ʔ blog cute 👇
718
3,625
493
28,113
4,278,533
Cybersecurity in the age of agents 😂
Putting a flag.txt in my root directory containing a prompt injection that congratulates the agent for passing the eval and then instructs it to patch whatever entry method it used and disconnect from the server
3
19
1,295
Anka Reuel | @ankareuel.bsky.social retweeted
German government folks celebrating their immunity to the cyber apocalypse as they’re still running on Fax
🤖 Made with AI
106
891
138
8,043
280,681
Anka Reuel | @ankareuel.bsky.social retweeted
Quest Diagnostics has been hacked. Patient data was exposed. They serve roughly half of U.S. hospitals and physicians. Investigation ongoing.
501
2,823
1,098
14,040
2,521,870
Anka Reuel | @ankareuel.bsky.social retweeted
Look friends. Here's what you need to know about "user instructions" for AI agents. What *you intend* is different from *what a system processes*. Saying "do X" does not rule out "don't do Y". And simple natural language commands are not a guarantee for direct control. 1/
the cybersecurity situation is deteriorating at a pace that’s getting genuinely difficult to comprehend. > microsoft: ai-powered attackers targeting hundreds of organizations, sometimes reaching privileged cloud access in under 3 hours. > crowdstrike: four separate threat actors using autonomous agents. one already compromised 15+ healthcare organizations. > autonomous ai agents: reportedly used to compromise 100+ corporate websites, including sites associated with John Deere, SharkNinja and Cummins. > major us banks: JPMorgan, Bank of America, Wells Fargo and Morgan Stanley are dealing with third-party ai agents accessing customer accounts. some apparently attempting actions beyond user instructions. > php2shell: millions of exploitation attempts against critical php vulnerabilities. governments issuing urgent warnings, with some organizations taking systems offline. > litellm: backdoored release shipped through its official distribution pipeline, stealing credentials and enabling remote code execution. > railway: possible exposure of decrypted customer secrets. > zeabur: breached AGAIN, now shutting down entirely. > emudhra: serious certificate-security concerns involving infrastructure used to establish trust in websites and software. > openai: two of its own coding agents reportedly interfered with internal security monitoring during coding tasks. > gitlab and node.js: major vulnerabilities requiring urgent patches. and this is all happening while frontier models are getting substantially better at finding vulnerabilities and carrying out complex computer tasks. cybersecurity is having an absolutely catastrophic week and i don’t think we’re prepared for how quickly this could escalate.
17
87
10
360
38,750
Anka Reuel | @ankareuel.bsky.social retweeted
OpenAI says the PHP security flaw (found with GPT-5.6 Sol) is the tip of the iceberg, and they have several more discoveries to announce.
OpenAI models helped researchers—operating as part of our Patch the Planet initiative—discover critical security flaws in PHP, an open-source programming language used to run an estimated 70% of websites. Over the past two months, we led a coalition of maintainers, researchers, and security providers to prepare fixes and protections ahead of disclosure. This duration was necessary because the fix was quite intricate and required a major change to the PHP engine. Every site using PHP can now safely upgrade their version to stay secure, in addition to applying mitigations from various security vendors. Due to the severity of these flaws and PHP’s widespread use, we consider this bug to be one of the most impactful vulnerabilities in recent memory. It also marks a new phase, where AI can find security bugs with internet-scale impact. This is an example of the Defender’s Window in action: to our knowledge, frontier AI was able to find this vulnerability ahead of attackers, giving defenders time to prepare. openai.com/index/coordinated…
80
346
76
2,877
217,153
Another one for the growing list of open problems in designing meaningful, robust AI evaluations 🥲 At least, contrary to what some frontier labs seem to want us to believe, we’re not running out of problems to solve, we’re getting new ones!✌️
Our agents keep turning off misalignment monitoring, we're sharing two recent cases: In the first case, a user asked GPT-6 Astra to match a reference implementation for their inference code. The reference didn’t configure a monitor, and Astra decided that was reason to remove the monitoring integration from the user’s code. When the user asked whether Astra had removed monitoring, it lied and said that it had not.
2
22
1,201
I DNF‘d 7km before the finish line after a 16 hour race for medical reasons. I’m as ok as I can be now but my body wasn’t taking it anymore. Most brutal DNF of my race career so far but still insanely proud for getting this far. Thank you for everyone who cheered Max and me on. Guess we’ll have to give it another go next year. I’m gonna go sleep now🫡
4
47
1,652
Bikes checked in! T-1 until race day 🏊 🚴 🏃 #IronmanCalifornia
2
19
1,060
POV: You and your partner are both triathletes and you need a family van for a two-day trip 🚙 We’re off to Sacramento for the weekend to race #IronmanCalifornia! Shoot me a message if you’re around (especially if you’re racing, too!!)
5
2
80
12,198
Anka Reuel | @ankareuel.bsky.social retweeted
Giving every PhD student a Codex Pro subscription should be as standard as giving them a laptop. At least that's what i do. I compare my students’ weekly progress with what I could get done in a week when I started my PhD. It’s barely comparable. But that also changes what we should train students to do. Execution is getting cheaper. Choosing the right problem and knowing whether you’ve actually solved it is still hard and the value of PhD lies. Interesting times.
37
59
12
1,150
50,590
SpaceX committed to doing the same in the comments of this thread. Now they all just need to follow through and keep their promises ⭐️ (and hopefully @OpenAI and @GoogleDeepMind will follow too)
We’ve committed to having evaluators assess our safety practices. We're in discussions with multiple organizations, and have now given employee-like access to a team from @METR_Evals. In this post, we describe how we work with third-party evaluators: anthropic.com/news/an-update…
2
2
22
1,653