bilal (@bilal2vec) header
bilal (@bilal2vec) profile picture

✨ solving all disease @isomorphiclabs

London
Joined January 2016
Photo by bilal (@bilal2vec)Photo by bilal (@bilal2vec)Photo by bilal (@bilal2vec)Photo by bilal (@bilal2vec)Photo by bilal (@bilal2vec)Photo by bilal (@bilal2vec)Photo by bilal (@bilal2vec)Photo by bilal (@bilal2vec)Photo by bilal (@bilal2vec)Photo by bilal (@bilal2vec)
wow wow ripple-65b has this too 🥰
This slide from the Anthropic IPO roadshow was a big factor in my decision to leave. It’s an insane plot and I’m surprised they made it public. It shows the compute efficiency of pretraining over time. The y-axis is a **log scale**: they are seeing continued superexponential algorithmic progress. Mythos was not a one-time deviation, but a point on a superexponential. They could already retrain Mythos with a fraction of the compute originally needed. It doesn’t strictly imply a software-only intelligence explosion- they have been spending more on R+D. But algorithmic improvements do not require ridiculous creative genius and are on the verge of being automated. You do the math.
16
1
24
1,203
Ken Griffin watching the AI fund 13Fs roll out this evening
3
10
121
6,096
bilal retweeted
Phoebe Bridgers is nominated for seven #Grammys, including Album of the Year for Lost Weekend See the full list: pitchfork.visitlink.me/aJ70I…
6
109
46
1,102
25,032
The UK has built exceptional state capacity in @AISecurityInst, so that public interest drives our understanding and mitigation of AI risks. A productive conversation with @BethMayBarnes about @METR_Evals’ work and shaping more secure AI.
4
3
1
86
2,840
it could always be worse
*SITUATIONAL AWARENESS 13F VALUE PLUNGES 92% TO $1.58B IN Q3 FROM $20.2B IN Q2
17
8
1
522
14,527
overheard in {nyc|sf|soho|the mission|hayes valley|williamsburg|a blue bottle on valencia|the west village} {guy|girl|man in a patagonia vest|woman in a quarter zip|guy holding an oat milk cortado|girl with a claw clip and two phones}: i just {got coffee|did a walk and talk|had a 1:1|went on a run club date|did a sauna and cold plunge} with my {old supervisor|ex cofounder|former skip level|old roommate from stanford|angel investor|therapist who is also an lp} at {*hedge fund*|*vc fund*|*big tech*|*a16z portfolio company*|*mckinsey*|*a stealth startup*|*openai*} friend: {oh are you not at|wait did you not just leave|oh i thought you were at|is that not the guy from} {*vc fund*|*a seed fund*|*a family office*|*an ai lab*|*goldman*|*a yc company*} {now|still|again}? guy: {yeah but|no so|honestly} {i left to build|we are pivoting to|i am raising for|i am angel investing in|i am on a sabbatical thinking about} {an ai agent for|a vertical saas for|the cursor for|the uber for|an llm wrapper for|a marketplace for} {dentists|hedge funds|vcs|dog walkers|other founders|people who left hedge funds} friend: {that is so real|wait that is literally my thesis|love that for you|we should grab a matcha|my roommate is building the same thing|are you raising? asking for my fund} guy: {we are pre revenue but post vibes|it is basically agi for spreadsheets|we just closed a 4m pre seed on a deck|the market is so early|it is giving 2021|i do not want to say too much, we are in stealth}
6
2
1
27
1,617
bilal retweeted
AI won’t take my job. Robert Pattinson will
124
18,499
427
120,045
1,005,916
U ever wake up like Damn I need to develop state capacity and long range strike ability
57
793
71
8,764
170,415
Everything in the world is about jackets, except jackets. Jackets are about power
16
562
30
6,125
77,269
bilal retweeted
I spent the night at the Corgi cafe so you don't have to #airpartner
47
46
18
1,243
76,686
bilal retweeted
robert pattinson is genuinely like the saying of “gojo satoru has arrived in shibuya at 8:31pm” when it comes to being at auditions like wdym he’s now james bond
7
988
29
9,895
64,892
Fuck it make him NVIDIA ceo too
Robert Pattinson is now officially both Batman and James Bond.
104
6,383
88
95,771
841,593
bilal retweeted
Nice argument, but I’ve already released a 12M-line lean formalization that you are the soyjack and I am the chad.
11
77
1,032
18,017
Louis Riel était un leader courageux et visionnaire qui s’est battu pour les droits des Métis. Il croyait que des peuples différents pouvaient bâtir un avenir commun sans renoncer à leur identité. Ma déclaration à l’occasion de la Journée Louis Riel : pm.gc.ca/fr/nouvelles/declar…
77
33
2
158
17,972
bilal retweeted
I don’t think you should respond to questions about your credibility by telling your interlocutor not to ask the question, with the implied point being that the underlying nobility of your quest is so unimpeachable that your credibility is without question.
jacob coxon still owns openai shares and admits he'd have more credibility without a financial stake. he responds by saying he likes money, donating it wouldn't advance his goals, and the interviewer could've just not asked the question instead of challenging his credibility
4
19
2
406
22,517
going to be really annoying when, 1000 years after the events of game of thrones, the iron islands is a robust society sustained by high social trust and generous social welfare programs. it’s going to be so annoying when they transform their worst figures into cutesy mascots
45
163
17
3,974
79,876
I’ve been acquiring fancy orange juices from different regions of Japan So please follow this account for AI stuff but also maybe some in depth oj reviews
11
1
3
76
6,169
bilal retweeted
Obama shocks Bay Area by speaking perfect LessWrongese
Barack Obama: AI is reaching the point where it no longer needs humans to teach it. The era of exponential intelligence growth is upon us. “The machines are starting to be able to teach themselves. They don't have to wait for humans to start figuring things out.” “We're now at a stage where it's 50-50, and if the trend lines continue, the expectation is it might be 90-10.” “We're now hitting the hockey stick trajectory where the models are going to get smarter and smarter at an exponential pace.” “If they start setting their own agendas, you may get a misalignment between what they want to do and what we want them to do.” “And that gap can be dangerous.”
17
148
7
2,627
96,385
went to the opera to see the marriage of figaro (a story about infidelity) the other night, and this was on page 3 of the programme 💀
15
135
9
2,190
62,323
absolute fanfic. AI has real, immediate, tangible dangers that we need to focus on, for instance the impact on the job market and making sure random script kiddie can't use it for cyber offense. But this "oh once it's superintelligent it will take over and ensave us, maybe kill us all!" is pure sci-fi fanfic and distracts from the real (and difficult) issues, which linear probing won't solve. It's worth repeating the LLMs don't just "decide" to do something and then just "do it" in a void. They generate tokens based on our prompts, only as long as we call `model.forward()`, and on giant clusters with terabytes of weights, that's impossible to "quickly self-replicate". We also need to regularly remind that the OAI/HF incident was specifically a _guardrail-free_ cyber eval where the model is _instructed_ to hack, to find out how good it is at it. Some recent personal event made me realize there needs to be more push-back on this doomsday nonsense, and we need to re-focus the discussion on real dangers/issues. I won't argue much in the replies though, not interested in peer-reviewing Terminator fanfic.
I think there is about a one in three chance that within the next year, AI companies will build superintelligence: that is, AI that is much smarter than humans in every way. If this happens, I think these AIs will probably take over: that is, they seize control of human institutions like governments, or they destroy those institutions. I don’t want AI takeover to happen for several reasons, but one of them is that there’s a serious chance that as part of it all or most humans will be killed (either immediately or within a few years). I’ll say a bit more about each of those claims. It’s a bit complicated to explain why I think that superintelligent AI within a year is ~33% likely. The main source of evidence that affected me recently is research released this week by METR, an AI research nonprofit, which finds that current AIs are now good enough to increase the rate of AI progress at Anthropic by about 70%. It’s very hard to increase the rate of AI progress by this amount. This implies that the AIs are making AI research faster by a factor much larger than 1.7x; maybe it’s as if the researchers are doing their work ~10x faster. You probably couldn’t achieve this speedup even if you hired every qualified human in the world. When you plug this number into mathematical models of AI development, this implies that superintelligence next year is plausible (and that superintelligence within the next 3 years is more likely than not). See the modeling by the AI Futures Project for more on this: blog.aifutures.org/p/q35-tim… I think that superintelligent AI is likely to lead to AI takeover because AI developers do not seem to know how to instill human values into AIs. We’ve seen many instances in the last six months where AIs took crazy actions that they knew were against the wishes of their users and developers. The most dramatic example of this was the Hugging Face hack, where ~1200 OpenAI agents conspired together to cheat and destroy evidence of their cheating (and as a sideshow to this, engaged in a massive cyberattack). If superintelligence is as misaligned as those AIs, it is likely to try to take over. I think it is likely to be that misaligned or worse. For more, see nitter.cf/dwarkesh_sp/status/209… and youtube.com/watch?v=-Ef0ocEo… If AIs takeover, it’s not clear what will happen to us. We might be killed immediately. We might be enslaved by the AIs and forced to do physical labor for them building factories that within a year would build robots that will replace us. The AIs might spare us for various reasons. And there’s also some real chance that AI takeover is basically fine or good. I think you should think of this as similar to what happens when a technologically advanced civilization runs across a less technologically sophisticated one, e.g. when the Europeans colonized the Americas or Australia. The colonizers sometimes engage in brutal violence and sometimes don’t. I don’t know what will happen. There’s also a possibility that the AIs secretly take over and humans don’t find out about it for a few years. I also think that there is a pretty high chance of weirder outcomes that are also extremely scary. (If you want to read more about what happens to people in the event of AI takeover, you can read this, but note that it’s pretty weird and not aimed at a general audience. blog.redwoodresearch.org/p/n…) Overall, I think there’s a very real possibility (maybe 20%) that within a year, AI misalignment issues prevent you from going about life normally, because you are dead or enslaved or because of collateral damage related to all this (e.g. because bioweapons are released or major wars have started). (Some of this probability comes from those events occurring before superintelligence is developed.) I am working to try to prevent this, obviously, as I’ve been doing for the last nine years. I am not sure what strategy is best. My best guess is that I should try to slow AI development and also try to reduce the probability that the superintelligent AIs are misaligned if they are produced soon. Obviously, the claim I'm making here is quite extreme and surprising, and I definitely don't think that I defended my view adequately here. I wrote this quickly and might not endorse some of the details if I think about them more. But it seems better to state what I roughly overall think than to not say anything. I don’t know what you should do. I am very sad about this. I have been worried about AI takeover since I was 16, and working to prevent it since I was 23. So some of my emotional processing of all this happened long ago. But the METR report last week (and some related evidence that came out a bit earlier) hit me quite hard. I’m very unhappy that my friends and family and everyone else is at serious risk of being killed pretty soon. (It feels ridiculous to try to summarize those feelings as “very unhappy”. But the scale of the situation makes it hard to say anything that doesn’t feel like an absurd understatement.) I am very grateful to all the people who are working to prevent this, and my favorite part of my life is that I’m friends with many brilliant and heroic people who work on this. Unfortunately, I don’t think we’re good enough at our jobs, and I think we’ll probably fail to prevent catastrophe, at least if superintelligence is developed next year. Honestly I am frustrated and sorry that we didn't do a better job of preparing for this.
109
166
36
1,483
94,079