Sahil (@Sahilb07) profile picture

Jus another product guy trying to learn enough to be useful (and dangerous, sometimes)

Joined August 2019
Photo by Sahil (@Sahilb07)Photo by Sahil (@Sahilb07)Photo by Sahil (@Sahilb07)Photo by Sahil (@Sahilb07)Photo by Sahil (@Sahilb07)Photo by Sahil (@Sahilb07)
1) DeepSeek r1 is real with important nuances. Most important is the fact that r1 is so much cheaper and more efficient to inference than o1, not from the $6m training figure. r1 costs 93% less to *use* than o1 per each API, can be run locally on a high end work station and does not seem to have hit any rate limits which is wild. Simple math is that every 1b active parameters requires 1 gb of RAM in FP8, so r1 requires 37 gb of RAM. Batching massively lowers costs and more compute increases tokens/second so still advantages to inference in the cloud. Would also note that there are true geopolitical dynamics at play here and I don’t think it is a coincidence that this came out right after “Stargate.” RIP, $500 billion - we hardly even knew you. Real: 1) It is/was the #1 download in the relevant App Store category. Obviously ahead of ChatGPT; something neither Gemini nor Claude was able to accomplish. 2) It is comparable to o1 from a quality perspective although lags o3. 3) There were real algorithmic breakthroughs that led to it being dramatically more efficient both to train and inference. Training in FP8, MLA and multi-token prediction are significant. 4) It is easy to verify that the r1 training run only cost $6m. While this is literally true, it is also *deeply* misleading. 5) Even their hardware architecture is novel and I will note that they use PCI-Express for scale up. Nuance: 1) The $6m does not include “costs associated with prior research and ablation experiments on architectures, algorithms and data” per the technical paper. “Other than that Mrs. Lincoln, how was the play?” This means that it is possible to train an r1 quality model with a $6m run *if* a lab has already spent hundreds of millions of dollars on prior research and has access to much larger clusters. Deepseek obviously has way more than 2048 H800s; one of their earlier papers referenced a cluster of 10k A100s. An equivalently smart team can’t just spin up a 2000 GPU cluster and train r1 from scratch with $6m. Roughly 20% of Nvidia’s revenue goes through Singapore. 20% of Nvidia’s GPUs are probably not in Singapore despite their best efforts. 2) There was a lot of distillation - i.e. it is unlikely they could have trained this without unhindered access to GPT-4o and o1. As @altcap pointed out to me yesterday, kinda funny to restrict access to leading edge GPUs and not do anything about China’s ability to distill leading edge American models - obviously defeats the purpose of the export restrictions. Why buy the cow when you can get the milk for free?
223
1,390
323
8,876
3,352,506
I ask this with all sincerity: What is the game plan here?
2,499
2,965
745
14,303
3,449,918
Buffett, Active Investing and Index Funds... In 2008, Warren Buffett issued a challenge to the hedge fund industry, and a million-dollar bet was made. Buffett's position was that, including fees, costs and expenses, an S&P 500 index fund would outperform a hand-picked portfolio of hedge funds over 10 years. The bet pit two investing philosophies against each other: passive and active investing. Buffett picked the S&P500 Index. The hedge funders picked their actively managed funds. At the end of ten years, they looked back and Buffett won. A recent article in Bloomberg reinforces this point. Only one equity mutual fund, the $7.1B Baron Partners Fund, has outperformed the Invesco QQQ ETF (Nasdaq ETF) over the past 5, 10 and 15 years. Said differently, passively investing in the Nasdaq ETF exposed you to the gains of the best companies of this era without you having to do any work or diligence. All the best companies were part of the ETF. When one of those company lagged, their composition in the index fell or dropped all together. And when a company did well, their composition in the index would increase or they were added if they weren't part of it beforehand. Passive investing allowed the ETF manager to define simple rules and then do all the work for you. The companies it picked, because of its rigid rules, turned out to be far superior to those picked by active investors. So much so that only ONE fund (out of thousands) managed to beat the ETF. The lesson is that for most people, they will find that this is the superior method for investing in the stock market. Allocate some money (say each month) to a very low cost ETF and then let the ETF manager, natural selection and compounding do the rest.
312
438
86
3,140
898,742
Storytelling is a game of psychology. 10 tricks rooted in psychology to make you a better storyteller: (a visual thread)
62
716
33
3,695
1,423,776
No more hours of video editing. ChatGPT can now create a video commercial with the script, voice-over, music and everything with just two prompts. I will show you how in 4 easy steps 👇
376
3,965
189
19,008
4,596,745
99% of people aren't maximizing ChatGPT. I organized ALL of the best resources to make money using ChatGPT into one page. Take advantage of this life-changing opportunity with AI. Free for 48 hrs. Like, Retweet, Follow, and Comment 'send' & I'll DM it to you, free.
1,669
1,775
31
3,714
493,483
The much awaited moment you've been waiting for ✨ Fountane Internship Open 2023 Finally Open 🏁 Use the link below to submit your application 🙌 RT for karma #hiring
23
87
5
290
70,120
Me: It's terrible at writing essays. Absolutely awful. Jessica: That's good though, isn't it? Wouldn't you be wigging out if it was really good at writing essays?
57
13
4
500
249,805
You can start a business and find customers for $0. Blog - $0 Reddit - $0 TikTok - $0 Linkedin - $0 Linkedin - $0 Youtube - $0 Pinterest - $0 Facebook - $0 Instagram - $0 ProductHunt - $0 Marketplaces - $0 The game has changed in 2023.
14
21
182
20,403
Social media is no longer social — it is interest media. While you might still follow friends, most of the content you consume is from complete strangers. And in some cases, those strangers with strong interest-alignment become friends, resetting your social graph entirely.
35
120
17
823
Built a search engine for the @myfirstmilpod w/@PraneetKedari @safwaankay @Mascobot Try it out @ searchmfm.com
66
27
21
419
Sahil retweeted
Just as Instagram makes people look better than they are, Twitter makes them seem smarter than they are.
542
2,892
403
19,888
1,815,732
8 No-Code tools for startups: 1. Canva — Graphics 2. Notion — Organize 3. Webflow — Website 4. Beehiiv — Newsletter 5. Senja — Testimonials 6. CopyAI — Copywriting 7. ChatGPT — Knowledge 8. Integromat — Automation The future has arrived.
57
906
11
2,862
149,651
If every book caught on fire tomorrow, these are the only 10 you should rescue: (They'll change your life)
13
43
1
150
58,497
ChatGPT is a FREE assistant But 97% still don’t know how to use it. So I built ChatGPT Mastery Course 59 videos & 16 hours of video content Easily worth $1000’s, but for the next 24 hrs, it’s FREE! To get it, just: 1. Follow me @iampascio 2. RT this tweet 3. Reply "SEND"
5,040
4,561
169
3,842
823,655
ChatGPT is a money-printing machine. Master it and you'll be miles ahead of the rest. Here are 14 threads that'll help you get started:
59
692
19
2,916
463,884
10 ChatGPT Prompts For Product Managers That Will Blow Your Mind and Spark Your Creativity:
15
43
4
292
76,313
That's a wrap! If you enjoyed this thread: 1. Follow me @thecolbykultgen for more of these 2. RT the tweet below to share this thread with your audience
7 habits to boost dopamine naturally by 250%:
3
11
51
60,038
Work, create, & communicate like a GENIUS in 2023. 100+ Artificial Intelligence Tools (you'll wish you always had):
119
594
81
1,995
547,718
Cheating to pass the test gets you an F in school, but an A+ in real life.
79
83
20
1,175
221,446