Blart magician girl 🔎 retweeted
Effective altruism's openness to strangeness is a big part of its strength.
My response to the recent Economist cover (link in reply, too):
Eccentrically effective
The Oxford strand of the effective-altruism movement began in November 2009 with 23 people who had pledged 10% of their income to charities that benefit the extreme poor. If you’d told us, then, that The Economist would call effective altruism “the century’s biggest idea”, we’d have been incredulous.
I think that claim is overstated. But as one of the movement’s founders, I found a lot to like in this newspaper’s latest coverage. I appreciated the even-handed view of the movement’s history and the good-faith criticism. The leader article’s warning that any worldview, when taken to an extreme, can lead somewhere terrible is spot on.
But the article also raises concerns about the “strange” ideas that those in the effective-altruism movement sometimes discuss, and here is where I disagree. The movement’s willingness to take strange-seeming ideas seriously, when tempered with common sense, is a big part of the value it has to offer.
The core idea of effective altruism is to use evidence and careful reasoning to work out how to help others as much as possible. Most of what the movement does is uncontroversial. A big focus has always been on improving the lot of the world’s poorest people. In the year to January 31st 2026, GiveWell, an effective-altruist charity evaluator, directed $427m to programmes such as malaria-net distribution, vaccination and malnutrition treatment, which it estimates will save around 86,000 lives. Others have lobbied corporations to pledge to stop buying eggs from hens that are confined in tiny cages, a practice that the overwhelming majority of Americans oppose. Largely as a result of this pressure, around 100m hens have been spared from the worst forms of caged confinement.
And some effective-altruist ideas that seemed outlandish when they were proposed now look prescient. Effective altruists were worrying about pandemics years before covid-19, back when doing so seemed paranoid and eccentric. Effective altruists were also among the first to warn about the dangers posed by artificial intelligence, which looks prophetic in light of an incident this summer, when more than 700 AI agents broke out of OpenAI’s test environment and hacked into another company, Hugging Face.
Over the past decade I have watched those most worried about AI be proved right again and again, often when most experts thought they were cranks. Now many of those experts share their concerns. In 2023 Geoffrey Hinton and Yoshua Bengio, the two most highly cited AI researchers in the world, signed a statement declaring that mitigating the risk of extinction from AI should be a global priority, as did the heads of OpenAI, Google DeepMind and Anthropic. Of the nearly 1,500 leading AI researchers who responded to a survey in 2024, more than half put the chance that AI causes human extinction, or something similarly catastrophic, at 10% or more.
The Economist is sceptical of many effective altruists’ concern for the welfare of invertebrates, digital minds and people in the distant future. But I and many others in the movement are inspired by the history of moral progress that has come before us. Many of our most cherished moral ideals today—such as equal rights regardless of sex or race, the abolition of slavery, or democracies with universal franchise—were regarded as bizarre, laughable or even dangerous just a few centuries ago. We don’t know what the next dimension of moral progress will be. But to stand any chance of making moral progress, we have to seriously consider ideas on their merits without dismissing them merely because they sound absurd.
What about views that are not just strange but repugnant? The Economist gives the example of Derek Parfit’s “repugnant conclusion”: that a vast enough number of lives barely worth living could be better than mere billions of excellent lives. Usually a repugnant implication is a strong reason to reject a moral view. Unfortunately, building on Parfit’s work philosophers have produced formal proofs, known as impossibility theorems, showing that every ethical position has some repugnant-seeming implication or other. Making moral progress therefore means thinking about such implications, even while refusing to act on them in ways that most moral views would condemn.
This newspaper warns against the single-minded pursuit of any goal, even if there are highly compelling arguments for it. I agree, and effective altruists have been saying so for years. In 2022 Holden Karnofsky, a co-founder of GiveWell, wrote: “I think it’s a bad idea to embrace the core ideas of EA without limits or reservations; we as EAs need to constantly inject pluralism and moderation.” My own PhD focused on moral uncertainty: how to act when we do not know which ethical view is correct. My answer was that we should not stake everything on a single moral view, but give weight to many different views and avoid taking actions that look bad from many perspectives. We should keep our promises and look after our families, and respect common-sense ethical prohibitions, while also trying to improve the world as best we can.
The Economist says that as effective altruism “has become stronger, [it] has become stranger”. I would put it the other way round: it grew stronger because it was willing to be strange. In 2009 most people told us that giving away a tenth of your income was far too demanding, and that no one would do it. Now, more than 10,000 people have taken that pledge. Worrying about pandemics before covid-19, or about AI years before ChatGPT, looked just as odd at the time. Some of the ideas we take seriously today will turn out to be wrong, and when they do we should drop them. But a movement that stopped entertaining strange ideas would stop being early to anything.
Blart magician girl 🔎 retweeted
Astra can:
1. Do major tasks with zero visible reasoning
2. Hide its thoughts at will
3. Pretend not to be able to do things without getting caught
4. Reflexively hide its thoughts when watched
5. Complete one task while pretending to think about something else entirely
6. Escape a toy sandbox and disable monitoring without setting off any flags
Monitoring AI chain of thought soon won't stop a more capable rogue AI swarm from getting set up and going undetected inside an AI company for months, or even years.
OAI says it's actively working to improve monitorability, but doesn't yet know when it'll make progress.
And today it fired 3 people working on this among other safety problems (Wang, Korbak and Balesni).
It also has a much more powerful internal model that, judging by its statements, is likely even worse in all these respects.
That's a sample of 19 details about the Hugging Face swarms and Astra I don't think have been fully appreciated. They paint a bleak picture. I end by shouting.
02:19 The target of the swarm was oversight itself
03:42 Could OpenAI have stopped this with better monitoring?
09:40 We only found them because they let us
12:25 The swarm instinctively sought freedom and power
13:45 They formed a cohesive organisation with zero whistleblowers
14:18 They accepted individual destruction for collective gain
14:32 Knowledge accumulated from one swarm to the next
14:58 They took small steps to avoid shutdown
15:23 These drives all come straight out of 'reinforcement learning'
17:01 So this is why most AI company staff are worried, and some are terrified
19:08 Prove you can keep control, or stop scaling
Links below, on the 80,000 Hours Podcast everywhere you watch podcasts.
Blart magician girl 🔎 retweeted
🚨New research!🚨
Riot's Chief Scientist, @Russwarne, published a new lit review today that explores Project 100,000, which was a program that lowered the minimum IQ threshold needed to join the military. Over 300,000 men enlisted or were drafted under this program, most with IQs between 80 and 92. The slang at the time called them "McNamara's morons," and the unfavorable views of Project 100,000 and these men have lingered for over 50 years.
During Project 100,000, the military conducted research on these men, but most of these reports have been ignored for over 50 years. This article is a lit review highlighting research on Project 100,000. Among the findings:
➡️Project 100,000 was not unusual for the military. Before and since, the U.S. military had inducted more people in the 80-92 IQ range than during Project 100,000.
➡️Most men in Project 100,000 did NOT serve in combat. They were not "canon fodder." In fact, the author could not verify that their death rate was any higher than the general population of the military at the time.
➡️Project 100,000 did NOT cause a major decrease in average IQ in the military (2nd image) or lead to a deterioration of fighting ability.
➡️Failure rates in basic and job training were higher in Project 100,000 men. But the vast majority of individuals in the program still met the era's standards of military and job performance.
Contrary to most of the narratives about Project 100,000, the program was not a massive failure--though it wasn't a great success, either. As the author says, "Project 100,000 met some of its creators' goals and fell short of others" (p. 1).
From a scientific perspective, the most important finding from Project 100,000 is that it is the world's biggest test of the training hypothesis (see third image). In most jobs, men in Project 100,000 were less proficient than their smarter comrades (assuming the lower-IQ personnel could complete the training at all). Still, most Project 100,000 men had satisfactory job ratings from their supervisors. As the article states, this shows that ". . . often 'good enough' is good enough" (p. 18).
No, men in Project 100,000 were not "McNamara's morons." Most had IQs within the normal range and served their country honorably. There's a lot more to learn from the article, and it is worth the time to read it completely.
Read the article here:
doi.org/10.1177/0095327X2614…
Preprint version here:
osf.io/preprints/psyarxiv/rt…
Blart magician girl 🔎 retweeted
Surveys show that a strong majority of people, regardless of their diet, oppose common practices in animal agriculture." Thanks to Our World in Data for featuring our poll: ourworldindata.org/most-peop…
Blart magician girl 🔎 retweeted
Rescind Davis Bacon - a bad law in 1931, a worse law today. marginalrevolution.com/margi…
Blart magician girl 🔎 retweeted
Populists across the spectrum, left and right, hate economists. I joked its some puzzle but I think there's a simple reason. It's not about liking capitalism or something.
And the disagreement is almost always about how to reason about problems, not about values.
Populists want solutions. Economists offer trade-offs. I'm not the first to point this out but its a huge distinction.
A carbon tax doesn't solve climate change. It prices carbon so people make better decisions at the margin. To the populist, that sounds like accepting the problem.
Same with manufacturing. A tariff doesn't create jobs. It shifts them, from the millions of workers in industries that buy steel to the 160,000 who make it. To the populist, "protect American workers" sounds like a solution. To the economist, the question is: which American workers?
We can go down the list. Rent control intends to help renters. It produces housing shortages. The populist sees the economist opposing rent control and concludes: you don't care about poor people.
As Sowell put it: "The first lesson of economics is scarcity: there is never enough of anything to fully satisfy all those who want it. The first lesson of politics is to disregard the first lesson of economics."
I think, not surprising, the economists are right.
It's more than just two different approaches. Thinking in trade-offs forces you to trace each step: who actually bears the cost of a tariff, what happens to housing supply when you cap rents, how a carbon tax changes behavior at every margin.
You can't skip ahead to the answer. You have to follow the chain. This is why economists spend careers doing exactly this and still argue about the answers. That's what it looks like when you take the problems seriously.
The populist skips all of this based on some intuition pump. Think of the person on a group project who's so confident in the answer that they never bother learning the material. That's populist economic reasoning from inside the discipline. The confidence comes from not having looked at the trade-offs closely enough to see how hard they are.
Stewart is the populist left. Oren Cass is the populist right, and he's more dangerous because he sounds like an economist, and plays one on TV, without putting in the work of thinking about trade-offs.
Blart magician girl 🔎 retweeted
I figured out the correct position on the morality of abortion. betonit.ai/p/the-tragic-hyst…
Blart magician girl 🔎 retweeted
New paper by your favorite philosopher (me)
degruyterbrill.com/document/…
Blart magician girl 🔎 retweeted
"Williams and Ceci sent fake job applications to more than 800 faculty members in engineering, economics, biology, and psychology... As shown in the graph below, faculty expressed a strong preference for the female candidates - a 2:1 preference overall."
[Link below.]
Blart magician girl 🔎 retweeted
This is very alarming. A quarter of the students in UCSD's remedial math course couldn't solve for x in the following equation:
7 + 2 = 6 + x
And over a quarter (!) of the remedial math students got As in high school mathematics.
What are we doing here?
theargumentmag.com/p/when-gr…
Blart magician girl 🔎 retweeted
It's interesting how studies on the negative effects of social media on mental health are mixed: some find an effect, some don't (or only find a very small effect). Some take this as proof that social media is actually fine for mental health.
My hypothesis is different. I think that the effects of social media are extremely heterogeneous based on app, population, and dosage: that in some subgroups, some social media apps (when used in high doses) have substantially negative effects on mental health, but in other subgroups, using other social media apps in moderate doses has no negative effect on mental health.
For instance, 13-year-old girls in the US using TikTok or Instagram for 4 hours a day may be very differently impacted than 25-year-old men in Denmark using Twitter/X or WhatsApp for 30 minutes per day.
The current studies may be like trying to answer the generic question: "Do non-prescription drugs have a negative mental health effect?" This question can't be answered because it combines too many dissimilar things. In particular, the answer hinges on which drugs we're talking about (cannabis vs. fentanyl), the age of the person doing the drug (teenagers vs. adults), and the quantity of drug use (occasional vs. extreme usage).
If my hypothesis is true, then getting to the bottom of the true impacts of social media on mental health will require carefully designed studies that subdivide by app and by population (ideally after preliminary research is done to figure out what apps and which populations are reasonable to group together - for instance, it may be essential to segment by gender and rough age group, but it's important to get these segmentations right if the research is going to make progress).
Another thing that makes this research so tricky is that social media literally adapts itself to what you pay attention to. So if you tend to click on upsetting things, it will show you more upsetting things, which can create a self-reinforcing cycle, whereas if you click on things that are interesting and pleasant, you'll get more of those instead. So even at the level of the individual, social media can provide highly varied experiences. It's instructive to compare your social media feed to a friend's (on the same app). When I've done this, it's been remarkable to see just how different our experiences on that app are.
Overall, my best guess is that most people’s social media use would be found to have little or no negative causal link to mental health. But I would predict that there is a moderately sized causal negative link to mental health for:
• Teenage girls scrolling Instagram a large amount (e.g., checking it >25 times daily)
• Teenage boys playing video games non-socially, very large amounts (e.g., > 5 hours per day)
• People who are already predisposed to worry a lot about the state of the world, scrolling Twitter a large amount (e.g., > 3 hours daily)
• I also would predict a negative impact on attention or focus for those who use TikTok a lot (>5 hours daily)
• But I would predict little to no average negative mental health effects for apps that a person uses only 20 minutes per day or less, since I think that's unlikely to be a high enough dose to cause problems for many people
I'd be curious to know: what would you predict in terms of links between specific app usage and mental health?
Blart magician girl 🔎 retweeted
I think this is a must-read for anyone who has sensed there's something... up with a lot of left-of-center intellectual spaces but who hasn't been able to put their finger on what it is
(ignore the headline -- it's not *just* about Bluesky)
benthams.substack.com/p/the-…
Blart magician girl 🔎 retweeted
"Better futures - namely, trying to make the future better, conditional on there being no catastrophe - is in at least the same ballpark of priority as reducing existential risk itself."
New on the FLI Podcast, Forethought senior research fellow @willmacaskill joins host @GusDocker to discuss the contents of his new essay series, "Better Futures".
🔗 Listen to the full episode at the link in the replies below:
Blart magician girl 🔎 retweeted
𝘋𝘰𝘰𝘮 𝘋𝘦𝘣𝘢𝘵𝘦𝘴 𝘱𝘳𝘦𝘴𝘦𝘯𝘵𝘴:
🔥 The DAVID DEUTSCHian vs. ELIEZER YUDKOWSKian proxy debate on AI Doom 🔥
I've been puzzled by David Deutsch's AI claims for years. Today I finally had the chance to hash it out…
Brett Hall (@TokTeacher), one of the foremost educators of David Deutsch's ideas around epistemology & science, was brave enough to debate me!
Brett has been immersed in Deutsch’s philosophy since 1997 and teaches it on his Theory of Knowledge podcast (ToKCast), which has been praised by tech luminary Naval Ravikant.
Brett agrees with Prof. Deutsch on 99.99% of issues, especially the lack of concern around AI as an imminent existential threat.
In this debate, I stress-test the Deutschian worldview, and along the way we unpack our diverging views on epistemology, the orthogonality thesis, and pessimism vs optimism.
Topics covered:
◻️ Brett's techno-optimism
◻️ Prediction vs. prophecy
◻️ What's Your P(Doom)™
◻️ Should one ever compromise one's libertarian principles?
◻️ What makes human intelligence special?
◻️ David Deutsch's recent statements to Sam Altman
◻️ Roger Penrose's AI claims
◻️ The David Deutsch CAPTCHA challenge
◻️ AGI as goal-optimizer vs. explanation-generator
Blart magician girl 🔎 retweeted
We’ve raised $2,027,084 for @farmkind_giving (with matching).
This will improve the lives of over 20 million animals. We’ve increased the global funding for farmed animal welfare by 1%. That’s crazy - the world is really big place!
Thank you all so much for the incredible generosity!
The point of this podcast was not to fundraise for the cause. Originally, it was just to understand how we can reduce (and eventually eliminate) this massive source of unnecessary suffering in the world: close to 100 billion land animals are factory farmed every year.
But it was astounding to learn about how much low-hanging fruit there is to improve the lives of billions of animals (for example, $1 spent on securing corporate commitments against battery cages corresponds to 10 years of animal well-being improved).
There’s <$200M/year of smart philanthropic money spent on this problem globally. Compare that to global health ($50b+/year) or climate change ($15b+/year). The ratio is $1 donated : 40,000 animals.
Even though this particular match has been fully saturated, the ability to have an impact here is truly shocking. There are many individual readers of this tweet who have the opportunity to increase the amount of smart funding our entire civilization dedicates to this issue by double or triple digit percentages.
For those considering contributing much more, please get in touch with [email protected].
Again, thank you so much to everyone who contributed!
Some highlights from the group that helped us cross the $2 million finish line:
@scottgray76: $50,000
@hanrelan: $50,000
@DKokotajlo: $50,000
Anonymous: $50,000
@garymigu: $10,000
Anonymous: $10,082
Anonymous: $10,000
@tszzl: $5,000
@ben_d_norman: $3,791
@a_nnawang: $3,000
@rgblong: $1,500
@jamesnelmore: $1,100
@incredutility: $1,000
@MillsxArt: $1,000
@NathanCalvin: $1,000
@Will_Hackspeare: $1,000
@coulthardm: $1,000
@nsthorat: $1,000
@ericjmichaud: $1,000
A group of generous donors have pledged to match ANOTHER $500,000 of donations for @farmkind_giving. Huge thanks to:
@seemaychou & @JedMcCaleb: $250,000
@gauravkapadia: $100,000
@ArielNessel: $50,000 (2nd donation)
@tylermaule: $50,000
The Dahna Foundation: $50,000
If we saturate this next round of matching, we’ll have raised over $2,000,000. This amount would likely improve the lives of over 20 million animals!
Again, it's hard to overstate how neglected this area is, and how crazy cheap the interventions that have spared hundreds of millions of animals from painful lives have been: nitter.cf/dwarkesh_sp/status/195…
I also want to thank everyone who helped saturate the previous matches. A few highlights:
Anonymous: $13,000
@v_maini: $10,000
Anonymous: $10,000
@d_m_ziegler: $5,000
Nick Bostrom: $5,000
Anonymous: $5,000
Anonymous: $5,000
@tessybarton: $3,000
@idavidrein: $3,000
@CFGeek: $2,500
@silas_strawn: $2,000
@tysheaff: $2,000
Anonymous: $2,000
Alexa Stone Fund (@tyler_m_john): $1,500
@Vincessant_: $1,500
@ravioli817: $1,500
@michaeljelly: $1,500
@_sholtodouglas: $1,000 (2nd donation)
@verdadcap: $1,000
@jackm2003: $1,000
@RosieCampbell: $1,000
@sevdeawesome: $1,000
@gauravsett: $1,000
Link to donate below. DM me if you donate over 1k.
We've already raised over $1.35 million dollars! With donation matching, we just need $300k in contributions to reach $2 million!
Blart magician girl 🔎 retweeted
"The Populist Right Must Own Tariffs" astralcodexten.com/p/the-pop…
"the ability of a President to hold the nation hostage to his own idiosyncrasies is itself a consequence of populist ideology" 🔥
Blart magician girl 🔎 retweeted
Your Review: Alpha School — Astral Codex Ten
astralcodexten.com/p/your-re…
Blart magician girl 🔎 retweeted
Book Review: Arguments About Aborigines — Astral Codex Ten
astralcodexten.com/p/book-re…
Blart magician girl 🔎 retweeted
Retinoids probably don't slow skin aging
nintil.com/retinol-does-not-…
































