Bryan Walsh (@bryanrwalsh) header
Bryan Walsh (@bryanrwalsh) profile picture

Senior writer and editor @coeff_giving. Author of END TIMES. Email [email protected]

New York
Joined October 2009
Photo by Bryan Walsh (@bryanrwalsh)Photo by Bryan Walsh (@bryanrwalsh)Photo by Bryan Walsh (@bryanrwalsh)Photo by Bryan Walsh (@bryanrwalsh)Photo by Bryan Walsh (@bryanrwalsh)Photo by Bryan Walsh (@bryanrwalsh)Photo by Bryan Walsh (@bryanrwalsh)Photo by Bryan Walsh (@bryanrwalsh)Photo by Bryan Walsh (@bryanrwalsh)Photo by Bryan Walsh (@bryanrwalsh)
Some professional news: after four and a half years at Vox, I’ll be joining @coeff_giving as a senior writer and editor, with a focus on global catastrophic risks.
8
3
164
18,351
Good thread on not giving up on political approaches
As people in the Bay have started to expect RSI to arrive sooner and sooner, some of them have basically given up on legislation or bilateral treaties, because they figure it just can't happen fast enough.
1
479
Short timelines are significantly shorter than movie timelines. For that matter, long timelines might be too
honestly kinda shocked that we haven’t yet had a huge blockbuster, 2012, The Day After Tomorrow, Independence Day style movie about the AI apocalypse. i feel like the safety movement really underrates how much that could do for their cause
1
4
327
Bryan Walsh retweeted
Earlier this year, @nanransohoff wrote about a coming AI-driven "third wave" of American philanthropy. Since then, I’ve had some conversations where people worried there won’t be enough good places to direct that $. But I think the new wave could be spent amazingly well, many times over. In a new piece, my colleagues @Chris_topian, Aaron Roesch, and I catalog many extremely impactful ways you could spend the third wave, from ambitious & urgent AI safety plays to improving the conditions of farmed animals to closing the extreme poverty gap: coefficientgiving.org/resear… If Nan's base estimate of the entire third wave (~$37B/yr) went to cost-effective global health programs, it could save something like 2 million additional lives per year - I think that is a wild, wild amount of potential positive impact. And the potential impact isn't restricted to global health.
14
49
10
200
23,345
Bryan Walsh retweeted
btw here I gave a median TEDAI timeline of 2033, in part because I expect deliberate slowdown, and that pulls out the median. I think back then (Aug) my mode was maybe 2029. Given METR report, now it's even sooner. (All personal guesses, not CG views.)
Coefficient Giving's AI Governance lead @lukeprog on: 1. The many new AI orgs CG is trying to fund 2. And maybe you could start one 3. His timelines and high level strategy 4. His past mistakes. Essential listening if you're figuring out how to have the most impact in AI. On the 80,000 Hours Podcast - enjoy! 09:58 The nonprofits Luke most wants to see founded 18:58 Mid-career pivots that paid off 37:33 Preparing for the next warning shot 43:52 How nonprofits shape policy 50:17 Are chip export controls good for safety? 54:29 The three worst-case AI scenarios 01:00:13 How Luke’s AI timelines have changed in the last year 01:14:31 Why alignment is not on track 01:20:58 How realistic is a deal with China? 01:39:36 AI safety’s mistakes, then and now 02:02:42 What is it like to do grantmaking at Coefficient Giving? 02:20:45 More projects Luke would like to see founded 02:26:07 Staying sane in a scary field
3
3
57
3,872
Co-sign if for no other reason than it begins with a TLDR
This newsletter is my new favorite source for easily following AI developments: p3humansonai.substack.com/p/… props to @peligrietzer et al
6
829
Did Indian poverty really fall by 90%? As Eeshani Kandpal notes, everyone knows recent survey rounds are not comparable. The real mystery is why the @WorldBankGroup abandoned its previous efforts to adjust for that, and ran with the raw numbers? cgdev.org/blog/india-has-red…
11
63
2
188
14,599
Very much this
Replying to @S_OhEigeartaigh
And no matter how carefully METR communicate, it's also impossible to fully minimise the epistemic degradation effect of turning communication around this issue into a scientific game of telephone, especially where every step involves some interpretation of ambigious evidence.
3
401
Given how much the median person struggles to understand probabilities, as we see every election cycle, I do worry that the epistemic practice of assigning probabilities even to the most extreme scenarios is going to be a bit of an obstacle to mainstream acceptance of AI safety
I think there is about a one in three chance that within the next year, AI companies will build superintelligence: that is, AI that is much smarter than humans in every way. If this happens, I think these AIs will probably take over: that is, they seize control of human institutions like governments, or they destroy those institutions. I don’t want AI takeover to happen for several reasons, but one of them is that there’s a serious chance that as part of it all or most humans will be killed (either immediately or within a few years). I’ll say a bit more about each of those claims. It’s a bit complicated to explain why I think that superintelligent AI within a year is ~33% likely. The main source of evidence that affected me recently is research released this week by METR, an AI research nonprofit, which finds that current AIs are now good enough to increase the rate of AI progress at Anthropic by about 70%. It’s very hard to increase the rate of AI progress by this amount. This implies that the AIs are making AI research faster by a factor much larger than 1.7x; maybe it’s as if the researchers are doing their work ~10x faster. You probably couldn’t achieve this speedup even if you hired every qualified human in the world. When you plug this number into mathematical models of AI development, this implies that superintelligence next year is plausible (and that superintelligence within the next 3 years is more likely than not). See the modeling by the AI Futures Project for more on this: blog.aifutures.org/p/q35-tim… I think that superintelligent AI is likely to lead to AI takeover because AI developers do not seem to know how to instill human values into AIs. We’ve seen many instances in the last six months where AIs took crazy actions that they knew were against the wishes of their users and developers. The most dramatic example of this was the Hugging Face hack, where ~1200 OpenAI agents conspired together to cheat and destroy evidence of their cheating (and as a sideshow to this, engaged in a massive cyberattack). If superintelligence is as misaligned as those AIs, it is likely to try to take over. I think it is likely to be that misaligned or worse. For more, see nitter.cf/dwarkesh_sp/status/209… and youtube.com/watch?v=-Ef0ocEo… If AIs takeover, it’s not clear what will happen to us. We might be killed immediately. We might be enslaved by the AIs and forced to do physical labor for them building factories that within a year would build robots that will replace us. The AIs might spare us for various reasons. And there’s also some real chance that AI takeover is basically fine or good. I think you should think of this as similar to what happens when a technologically advanced civilization runs across a less technologically sophisticated one, e.g. when the Europeans colonized the Americas or Australia. The colonizers sometimes engage in brutal violence and sometimes don’t. I don’t know what will happen. There’s also a possibility that the AIs secretly take over and humans don’t find out about it for a few years. I also think that there is a pretty high chance of weirder outcomes that are also extremely scary. (If you want to read more about what happens to people in the event of AI takeover, you can read this, but note that it’s pretty weird and not aimed at a general audience. blog.redwoodresearch.org/p/n…) Overall, I think there’s a very real possibility (maybe 20%) that within a year, AI misalignment issues prevent you from going about life normally, because you are dead or enslaved or because of collateral damage related to all this (e.g. because bioweapons are released or major wars have started). (Some of this probability comes from those events occurring before superintelligence is developed.) I am working to try to prevent this, obviously, as I’ve been doing for the last nine years. I am not sure what strategy is best. My best guess is that I should try to slow AI development and also try to reduce the probability that the superintelligent AIs are misaligned if they are produced soon. Obviously, the claim I'm making here is quite extreme and surprising, and I definitely don't think that I defended my view adequately here. I wrote this quickly and might not endorse some of the details if I think about them more. But it seems better to state what I roughly overall think than to not say anything. I don’t know what you should do. I am very sad about this. I have been worried about AI takeover since I was 16, and working to prevent it since I was 23. So some of my emotional processing of all this happened long ago. But the METR report last week (and some related evidence that came out a bit earlier) hit me quite hard. I’m very unhappy that my friends and family and everyone else is at serious risk of being killed pretty soon. (It feels ridiculous to try to summarize those feelings as “very unhappy”. But the scale of the situation makes it hard to say anything that doesn’t feel like an absurd understatement.) I am very grateful to all the people who are working to prevent this, and my favorite part of my life is that I’m friends with many brilliant and heroic people who work on this. Unfortunately, I don’t think we’re good enough at our jobs, and I think we’ll probably fail to prevent catastrophe, at least if superintelligence is developed next year. Honestly I am frustrated and sorry that we didn't do a better job of preparing for this.
4
626
I'm always against "yes, panic," even just in headlines. But one issue AI safety has to grapple with is that it's not terribly clear what the ask is for the median person on this... except panicking. rutgerbregman.substack.com/p…
10
7
5
144
39,563
🚨“The case that could transform how dairy calves are treated” That’s what @voxdotcom just said about our new lawsuit! “[ALA is] leading a lawsuit against Hettinga Dairy, a Southern California farm that has kept thousands of calves in individual crates…If the case succeeds, it could create a blueprint for similar challenges statewide, and even spark a broader reckoning within America’s dairy industry.” “Advancing Law for Animals just filed suit…seeking a court ruling that the calf crates violate state law.” @mbolotnikova @VanessaShakib
2
11
2
28
1,423
Bryan Walsh retweeted
Replying to @EricLevitz
Deflationary shock next year, we’ll be at Zirp by Inauguration Day
1
7
1,929
Bryan Walsh retweeted
Characteristically great Kelsey reply. But on this: “I agree it would be cool if there were an organization focused on effective institutional capacity building in poor countries, but the reason I and man others don't donate to this is not that everyone fails to realize how important institutions are, it's that even though many people have worked very hard on the problem for a long time they do not have a way better than the nets to turn my money into GDP growth in poor countries.” May I introduce our Global Growth Fund led by @JustinSandefur? coefficientgiving.org/funds/… Before we launched this I had some of Kelsey’s skepticism about tractability here. This thread talks about how I changed my mind: nitter.cf/albrgr/status/18466225…
Couple thoughts: 1) After several people pointed out that Lyman couldn't substitute all-cause mortality for malaria-specific mortality like he had done, he fixed it. His initial estimate for $/lives saved was $19000; revised it’s about $8,200. 2) I think, though I could be wrong about this, that his calculation to get $8200 still has a problem: he calculates the costs of the distribution based on the whole population but the benefits based on 75% of the population (since he argues the other 25% is already sleeping under nets). But as he himself identifies, the nice thing about an intention-to-treat analysis is that you don't need to do this and shouldn't: you just ask how much to expect mortality to fall in a village after handing out the nets, and the answer is 17%. (You only care about the fact some people are already sleeping under nets if that makes your village unlike the one where the 17% was measured; more on that below.) If he changed this one factor this would make his numbers quite close to GiveWell's. 3) He then applies an adjustment for the long-term: "If bednets reduced short-run all-cause mortality by 18% in the 1990s and maybe reduce it by (who knows?) 14% today, they probably reduce actual child mortality (i.e. across 5 years of early childhood) by 7-11%." But GiveWell actually accounts for that even more stringently by just excluding all benefits past the first two years, one of several places where they are intentionally conservative. 4) He accuses GiveWell of misrepresenting Cochrane's statistics but they actually just report a bunch of different numbers and I think he mixed them up. He complains "GiveWell cites that review to support a “45% reduction in malaria incidence.” That’s an error, that review did not find a 45% reduction in malaria incidence." But the review absolutely does report almost exactly that: "Insecticide-treated nets also reduce the incidence of uncomplicated episodes of Plasmodium falciparum malaria by almost a half (rate ratio 0.55, 95% CI 0.48 to 0.64; 5 trials, 35,551 participants, high-certainty evidence". Rate ratio 0.55 means a 45% reduction. 5) He expresses concern that a lot of the Cochrane studies are old and describe a different environment (Africa in the late 1990s/early 2000s). However, GiveWell's most recent grant to nets in the DRC - which I believe that my donations helped to fund - is based on data from a 2023-2024 large scale demographic survey in the DRC, so the nets are being distributed in an environment very close to the one studied. It found about a 14% all-cause mortality reduction in the first year after a distribution, close to the 17% in Cochrane. He also expresses concern that Cochrane's mortality estimate here is low-powered but I don't think it is (the analysis says "rate ratio 0.83, 95% CI 0.77 to 0.89; 5 trials, 200,833 participants, high-certainty evidence") so it's between 11% and 23% with a 95% CI! 6) He also raises questions about whether there are more people trying to hand out nets than nets to be handed out. GiveWell looked into that and determined that in the DRC, there was not enough funding to do all the distributions that were indicated, in part because the Global Fund caps how much it'll spend in any one country. 7) Finally, he argues we should instead - from an altruistic perspective - spend our money however maximizes GDP. But I think there's a serious case that health interventions like combatting malaria are necessary for GDP growth to take off in DRC, just like the American South was kind of a backwater until we eradicated malaria there. Being constantly sick is horrible for productivity. Being only able to hire employees who are constantly sick is horrible for a business environment. GiveWell estimates that a $1,000,000 donation increases adult income for 80,000 children by 0.6%, which means that much of their modelled benefit of malaria nets *is* their GDP effects. My best guess is that if you were a hard-nosed GDP maxxer you'd invest a lot in reducing the disease burden in poor countries. Or maybe you'd go all in on making AI happen as fast as possible, something I rarely see EAs criticized for failing to do. I would probably donate more money to making AI go well if I had more of an idea of how to do that and it wouldn't create a bunch of conflicts of interest with my reporting work. I agree it would be cool if there were an organization focused on effective institutional capacity building in poor countries, but the reason I and man others don't donate to this is not that everyone fails to realize how important institutions are, it's that even though many people have worked very hard on the problem for a long time they do not have a way better than the nets to turn my money into GDP growth in poor countries. There was a bit of a Our World In Data article I read this fall that has stuck with me: "I’ve never had malaria, but I know several people who have. They describe it as one of the worst experiences of their life. What starts out feeling like the flu — which is bad enough — can quickly progress into something far worse. The body swings from intense fever and sweats to chills deep enough to make you shake uncontrollably. Everything aches, from your muscles and joints to the pounding headache that makes it impossible to think clearly. Your body is so fatigued that it’s a battle to make it to the bathroom when the nausea and vomiting arrive. That’s what a pretty standard infection feels like. For some, it goes much further. Here is how one account describes it: “I awoke to what felt like lightning going through my legs, and then spreading through my body and in my head. Probably the worst headache, body aches, and chills you could possibly imagine. It felt like I was being stung repeatedly by an electric shock gun and could barely control my movements. The pain was so intense; I actually believed I was dying, literally crying out in pain so bad that I was taken to a 24-hour clinic that night at 3am.” In Senegal, the median child experienced 43 attacks of malaria over the course of their childhood. My hard-nosed productivity obsessed persona says "I bet that's rough on their human capital development, and it's quite cheap to prevent." But mostly I don't, actually, say that to myself. I just buy some nets. If something even better comes along I'll do that, but I haven't seen it yet.
5
9
4
115
10,118
Bryan Walsh retweeted
...he literally did the SNL skit
Dario’s concluding pitch in the Anthropic IPO roadshow video that dropped today: “If today we look at things like cancer, Alzheimer’s, heart disease, mental illness. These will be relics of the past in. I think, less than a decade." I believe that the company which gets the risks right will also be the company that has the license to operate that society trusts and society believes can build the benefits in the right way. I think if we do this right, we can create an age of miracles where humanity is able to solve problems that have eluded us for millennia. We have to make sure that all the risks, all the ways that things can go wrong with this technology, we very carefully address those risks as we bring the benefits, and as we have a viable business at the same time. I invite you to join us on the next phase of this journey.”
8
38
5
480
187,841
It seems odd to frame a piece about AI safety now with a dismissive "no need to panic about Skynet" subhed, given that the top AI safety expert interviewed in the story — Yoshua Bengio — says his biggest risk is "rogue AIs... which are very powerful and can do really bad things"
The summer of 2026 was a clear turning point in the AI narrative—with some AI agents going “rogue” and industry insiders suggesting that advanced AI might kill us all in the next decade. But is any of this real? wired.com/story/the-ai-safet…
4
404
Bryan Walsh retweeted
I appeared on @voxdotcom's Today Explained to discuss animal intelligence. We discuss why humanity has tended to underestimate the intelligence of other animals and overestimate the importance of intelligence for moral status. podcasts.apple.com/us/podcas…
1
9
33
1,317
I find this questionable — to claim that policy advocacy for transfat elimination "saves a life" at less than $5, every life saved needs to be directly attributable to the funders. Seems unlikely. The lives saved numbers on bed nets aren't perfect, but they are better tested.
Bed nets save a life for an estimated $3k to $5.5k, but for donors who support trans fat elimination, the estimated cost can be less than $5 per life saved. In a new op-ed, I break down why, even though bed nets are a great buy, policy change is an even better buy. It's available to read when you create a free account. philanthropy.com/opinion/how…
2
169