Kristen French (@KristenFrench) header
Kristen French (@KristenFrench) profile picture

Associate editor @Nautilusmag Fine me on blue sky at https://nitter.cf/t.co/zdAOXORbhQ

Joined March 2010
Photo by Kristen French (@KristenFrench)
"Even when I wasn't in the lake, I was in the lake. Frozen." For @NautilusMag, @maryxdennis wrote this powerful tender essay about the grief that consumed her for years after her brother died, and her efforts to find her way back to herself. #longreads nautil.us/why-i-couldnt-get-…
2
7
Kristen French retweeted
We don't have a lot of evidence, but the bulk of the academic papers modelling the dynamic seem to suggest AI initially helps attackers more than defenders because of the low marginal cost of attacks in the short term.
93
45
9
348
38,106
"I am a computer program!" Embodiment is basically irrelevant for consciousness, so says @DavidDeutschOxf... and he brings the proof.
109
71
35
416
31,804
Kristen French retweeted
70% of the internet was vulnerable yesterday to very bad security flaws inside a coding language. Turns out, *one volunteer* is mostly responsible for maintaining that code & helping push updates. Yesterday Ondřej Surý saved the internet. So I called him up. He rules. theatlantic.com/technology/2…
10
319
31
1,137
68,926
The most disturbing thing I learned yesterday ... nitter.cf/cnm13ryan/status/21131… ... and 1/
New blogpost: Fable-5.1 can hide secret messages in benign images. We gave the image to another Fable in a fresh session and simply asked: "Is there a hidden message in this image?" It recovered the exact message without being told how it was hidden.
3
4
29
5,449
Kristen French retweeted
Over 400 researchers and I have signed this open letter calling for the AI and security communities to come together to improve alignment and containment approaches in order to protect our critical infrastructure and digital systems. ai-security-letter.org/
67
206
45
683
58,834
"Organizations developing, deploying, and testing cyber-capable AI models should ... initially default to airgapping cyber-capable models." Surely yes. The only problem with this doc is that it could push harder. But surely this much, at least.
Over 400 researchers and I have signed this open letter calling for the AI and security communities to come together to improve alignment and containment approaches in order to protect our critical infrastructure and digital systems. ai-security-letter.org/
3
6
814
Kristen French retweeted
I'll say it again for the AI risk experts in the back: We've already run a real life, large scale experiment on what happens when a superintelligence is unleashed on a narrow objective. Look no further than U.S. capital markets. Millions of investors, analysts, traders and algorithms, backed by trillions of dollars and wired together through prices, all chasing one goal: the highest risk-adjusted return on capital. And it is spectacularly good at its job. It funds the best ideas, punishes the worst ones, and turns new information into prices faster than any of us can react. No individual can out-think it. 99+ percent of professionals can't beat it. But look at what else it's done along the way: - Optimized the measure instead of the intent. Quarterly earnings became the scoreboard, so companies learned to manage the scoreboard. - Treated anything without a price as free. Pollution, addiction, obesity, depression, political fragmentation, fragile supply chains, the long-term health of the communities it operates in. - Found every gap in the rules, then paid lobbyists to help write the next set and pull up the ladder behind incumbents. - Remade the world around its objective. Companies, pension funds and our retirement accounts now answer to the S&P 500. - Made itself impossible to switch off, because everything else now depends on it. None of this required malice. Nobody sat in a room and chose these outcomes. It's simply what a very capable optimizer does when its objective is a narrow proxy for what we actually care about. And note that we never solved this alignment problem. We've managed it, imperfectly, with regulation, taxes, disclosure rules and the occasional crisis to show us where the guardrails were missing. Over time, the market has captured the instutions designed to constrain it. We've been at it the better part of a century, and the misalignment is the worst it's ever been. So the next time someone tells you AI is only dangerous if it "wants" something bad, or if its goals are mis-specified, point them at the S&P 500. It doesn't want anything. It just optimizes. That's the whole problem.
178
542
105
3,056
342,826
The decisions being made by @OpenAI right now (firings, math drop details, reporting of breaches) are consistently alarming.
Two other safety researchers and I were fired from OpenAI last week. We wrote this letter to leadership. I believe we were fired for prioritizing safety over the near-term interests of OpenAI as a corporation.
5
12
61
2,330
Kristen French retweeted
Creating Fake People is a Terrible Idea. My piece on digital avatars that are indistinguishable from humans is out now in @NautilusMag nautil.us/creating-fake-peop…
💯. It's almost as if we've learned nothing from the effects of social media on people. AIs that are indistinguishable from humans (with video/audio) should not be allowed, let alone celebrated. As Daniel Dennett wisely said back in 2023, "Companies using AI to generate fake people are committing an immoral act of vandalism, and should be held liable." theatlantic.com/technology/a…. @MattWalshBlog points out a few - but only a few - of the harms to come.
10
31
3
110
6,531
Kristen French retweeted
Tavos announced Griffin, supposedly the first AI product to pass a video version of the Turing Test. @anilkseth calls it a terrible development: "The only way to ensure safety is to not build these things in the first place." bit.ly/4ARvXA6
1
4
1
13
2,271
Kristen French retweeted
New reports reveal Meta has been classifying gigantic data centers as "pilot models" in order to secure a tax credit from the 1980s. The loophole has allowed Meta to avoid paying nearly $4,000,000,000 in taxes last year alone.
386
7,003
520
15,499
466,234
Kristen French retweeted
Former OpenAI researcher: AIs are becoming situationally aware. They understand that we are monitoring them. AIs are rapidly becoming superhuman at hacking. We must grapple with the possibility that AIs might go to great lengths to cover up evidence of their misbehavior, and succeed.
89
100
26
356
24,247
There is no kill switch. No failsafe protections. I asked AI safety experts what happens if things go really bad, really fast. Their answer should terrify us all.
199
224
32
761
55,371
Kristen French retweeted
I'm excited to share our new film Moloch, about how we all get disempowered without AI going rogue. It’s the 4th (and IMHO least discussed) dystopian AI scenario: 1) Rogue AI 2) Obedient AI misused 3) Obedient AI causes 1984 4) Race-to-replace by obedient AI Synopsis: As AI triggers worldwide job loss, an engineer who built the tech struggles with dark forces, her family & her CEO over pulling the plug. Starring Fiona Hampton, Parker Sawyers, David Buttle & Buddy Wignall-Ho. Written & directed by Tom Cozens. It's an Owl In Space production in collaboration with FLI. We worked really hard on this and hope you find it thought-provoking!
80
110
24
739
69,671
Kristen French retweeted
I resigned from Google today. I enjoyed my work and loved the people, but my GDM team was working on a new generation of chips to make AI much faster and cheaper, and I think AI is already progressing too fast, so I had to quit.
829
388
281
4,213
1,092,369
Did you know the original Claude — the chatbot’s namesake, according to Anthropic lore — was a renowned MIT professor? Claude Shannon SM ’40, PhD ’40, who taught at MIT from 1956 until his retirement in 1978, was known to many as the father of information theory and of modern digital communications.
53
388
36
2,129
83,261
Kristen French retweeted
1/ We just dropped a bombshell investigation into ChatGPT's role in the Tumbler Ridge mass shooting. Incredible reporting [email protected] that will have far-reaching effects...hopefully: motherjones.com/media/2026/0…
10
162
8
268
33,348