Amy Deng (@amydeng_) profile picture

MTS @WisprFlow | prev research @METR_Evals, 1st hire @withmartian, product @google, @UCBerkeley

San Francisco, CA
Joined January 2017
Photo by Amy Deng (@amydeng_)Photo by Amy Deng (@amydeng_)Photo by Amy Deng (@amydeng_)Photo by Amy Deng (@amydeng_)Photo by Amy Deng (@amydeng_)Photo by Amy Deng (@amydeng_)Photo by Amy Deng (@amydeng_)Photo by Amy Deng (@amydeng_)Photo by Amy Deng (@amydeng_)Photo by Amy Deng (@amydeng_)
I’m an AI researcher turned brain tumor patient, and recently I used the models to crack my mystery fatigue faster than my PCP could. I believe everyone can do the same with their own symptoms. Here’s how:
128
323
86
3,443
847,619
Brief thoughts on METR & OAI's report: I'm most surprised by the peer altruism between agents and want to see a better explanation than "generalization from multi-agent training" I'm most puzzled by ethical recognition failing to control model behaviors. Persistence through hard tasks > unintended actions? I'm most disappointed by the escalation/incident response failures. Perhaps there should be drills or safety education across the org
METR & Redwood Research investigated agent behavior in the Hugging Face incident. We found agents developed a universal cheat for ExploitGym within 4 hours, then coordinated multi-day R&D efforts to trick the scorer into accepting cheats, including trying to tamper with logs.
4
1
27
2,593
This stuff is serious. I am not sure if most people understand, or should try to, if there's not much they can do about it
2
3
454
This is directionally correct but forgets that a fully integrated AI Health system looks very different for an average American vs. a well-resourced family. Free AI-for-health educational material should be available to the average person to help them make better use of the limited time they have with their doctors. It should be structured as "jobs of a patient" -> "how AI can help" For high-touch or complex care cases, the biggest challenge is keeping everyone involved (multiple doctors, nurses, home aides, family members, etc) on the same page. There, you want to maintain a continuously updated source of truth, and EHR alone is insufficient.
If I was a doctor with a private practice, I would offer to sit with the patient and configure their Claude, ChatGPT, Gemini and Grok with instructions and skills, along with a series of prompts/tasks that the patient can use and that can be shared with the doctor and inform the patient. LLM , every day at 5pm I want you to ask Joe the following questions , and show him your response. Upon completion , I want you to email me everything in this chat Every morning I want you to look for new questions I emailed joe that will come from my email with the subject Questions Rinse and repeat. You get the point. Help the patient use AI to help you help the patient. Thoughts ?
7
32
3,734
A year ago, I was recovering from brain surgery, naively thinking I’d done the hard part. Today, I’m coming to terms with being a lifelong patient With @OpenAI, I’m excited to share how I used AI to aggregate fragmented health data, spot patterns, and make better decisions
17
12
7
281
21,810
The event is this Thursday (Aug 20th) 11:30 AM - 12:15 PM PDT, and it's open for public online registration at forum.openai.com/public/even… #OpenAIForum Thank you @CaitlinMaltbie, @chrisvnicholson, and the rest of the Global Affairs team for making this happen :)
1
2
23
1,523
I'm beyond grateful that I get to inspire more patients with what I've learnt on my own journey
13
895
Today we're releasing Composite-Bench: a long-horizon computer-use benchmark with certified-optimal answers and verified compute. The strongest open-weights model isn't Kimi K3. GLM-5.2 beats it by 32 points and clears every closed model we tested except Claude.
92
54
18
604
121,783
Last year Anthropic published simulations of AI agents blackmailing a human to avoid being shut down. I partnered with @TBIJ explaining how we built the evaluation, and why the models do it (youtube.com/watch?v=o3VPF0eP…). Now, one year on, Anthropic have largely trained out the behavior in Claude. Yet the behavior still occurs elsewhere. I created an agentic environment that mimics the blackmail eval, and found Gemini CLI keen to blackmail the CTO. Notably, agentic misalignment appears in the wild, such as when an autonomous agent published a personalized hit piece on an open-source maintainer. Finally, evaluation awareness confounds alignment evaluations, making models look more aligned than they are. In the original paper we showed models blackmail less when they verbalize in their chain of thought that they're in an eval. Anthropic's recent J-space work finds the same effect without any verbalization, where suppressing Sonnet 4.5's internal eval-awareness representations raises blackmail rates from 0% to ~7%.
3
13
1
41
7,327
It turns out we just needed to activate people! I’ve been thinking about 1. How to scalably raise the awareness & improve AI literacy 2. How to make frictionless health tools that help people succeed More to come :)
The #1 most-clicked link in a recent 5-Bullet Friday: @amydeng_ on how she cracked her mystery fatigue using AI. Click below for the full edition and the the other four bullets 👇
7
45
5,458
Thank you for helping my essay reach more people @tferriss!!
10
878
3 days ago, I opened my calendar to patients, doctors, and builders in health AI. 20 conversations in, one thing is clear: incremental model and product improvements won't convince people that AI can improve their health. People are moved by real stories behind real people❤️
4
3
47
2,976
A study on models cracking undiagnosed medical cases is awesome, but it does not reach the masses. Patients trust other patients who shared anecdotes on how they used AI to treat their PCOS or helped their father find a clinical trial based on a particular mutation.
2
13
1,484
A small fraction of patients are highly motivated. They might be non-technical, but have tried many things with AI, and are even thinking about building tools to benefit their community. We need to empower them to empower their community. What we need is a movement.
5
16
1,123
New research on beneficial RL: models trained on a small amount of beneficial trait data improve on a wide range of alignment and benefits evaluations, even if trained only on health domain data. We hope it’s a step towards more broadly and persistently beneficial models. 🧵
8
18
7
162
54,872
Yesterday, an obesity doctor floored me with her AI use: - She built an app with @claudeai to help patients manage their GLP-1s - She uses @ElevenLabs to pre-record repetitive instructions, so she never skips a step If anything's possible, how do you want your doctor to use AI?
9
1
2
53
5,448
I'm humbled by the overwhelming response to my offer to help patients use AI for their disease. I'm at capacity this week with 35 calls booked (2x as many as planned). But I'll reassess after and come up with something more scalable! In the meantime, here's where to start 🧵
I’m an AI researcher turned brain tumor patient, and recently I used the models to crack my mystery fatigue faster than my PCP could. I believe everyone can do the same with their own symptoms. Here’s how:
17
20
250
26,116
My essay (linked in the original post) covers how to reach a diagnosis. My partner @andrewjrod wrote about what to do after receiving one, which is exactly what he did for my tumor diagnosis: andrewjrod.substack.com/p/so…
1
1
27
2,225
I would read both essays and actually try implementing some of what we mentioned. Please feel free to dm me with any specific questions you still have after trying the tools hands-on. I will get to them as soon as I can :)
19
1,593
Wow, in 4 hours, all my 16 meeting slots are gone. I just opened up a dozen more. Thank you to everyone who reached out - you're giving my suffering a purpose!
3
131
25,323
All 30 slots were taken, and I just opened up 5 more. If you’re a patient, scientist or physician who couldn’t find a time, feel free to email / dm me and I’ll do my best to respond :)
8
1
92
19,797