bagels.ai (@bagelsAI) header
bagels.ai (@bagelsAI) profile picture

founder + chief script kiddie @bagels.ai, a 🥯2🥯 (b2b) llm gen ai startup in stealth | cofounder of loxML (acq. 2020) | ex-OpenAI (catering) | 🤖+🥯=🦾

NYC
Joined July 2023
Photo by bagels.ai (@bagelsAI)Photo by bagels.ai (@bagelsAI)Photo by bagels.ai (@bagelsAI)Photo by bagels.ai (@bagelsAI)Photo by bagels.ai (@bagelsAI)Photo by bagels.ai (@bagelsAI)Photo by bagels.ai (@bagelsAI)Photo by bagels.ai (@bagelsAI)Photo by bagels.ai (@bagelsAI)Photo by bagels.ai (@bagelsAI)
I feel like this one held up
What people are going to do with AGI
4
2
82
5,006
a lot of sf startups work 996 bc deep down they know they’re not building anything differentiated. speed is the only edge left when you’re making the 57th lovable for excel.
158
232
63
5,137
279,440
Today, we announced that we plan to expand our use of Google TPUs, securing approximately one million TPUs and more than a gigawatt of capacity in 2026.
5
17
671
68,091
"Mom, how did we get so rich?" "Your father democratized access to private equity for retail investors to find exit liquidity for trillions of dollars worth of unsellable assets, sweetheart. Eat your Cheerios"
124
368
49
8,710
937,584
God is always with us .
55
1,210
79
9,106
1,473,281
bagels.ai retweeted
due to tariffs the optimal learning rate has dropped from 3e-4 to 5e-6
6
16
4
295
12,074
Thank you crowd worker number 48734 from crowd working company [REDACTED] for your gift of this data sample that has been (re)sold in its entirety to all the LLM shops for $128/hr
This might be the first large-scale application of AI technology to geopolitics.. 4o, o3 high, Gemini 2.5 pro, Claude 3.7, Grok all give the same answer to the question on how to impose tariffs easily.
3
3
17
3,082
our first 2 speakers @airstreet nyc ai meetup on 4/15 - @tylerangert of @patinasystems, spontaneous software, formerly of @replit - @ashedwardst of @fern_labs, multi-agent systems to write software, formerly of @palantirtech +2 more coming soon! rsvp: airstreet(dot)com/nycai
1
4
3
34
13,953
Shout out to that one Anthropic employee who is really good at acquiring bioweapons
38
189
20
3,624
220,991
How can we use small LLMs to shift more AI workloads onto our laptops and phones? In our paper and open-source code, we pair on-device LLMs (@ollama) with frontier LLMs in the cloud (@openai, @together), to solve token-intensive workloads on your 💻 at 17.5% of the cloud cost while maintaining 97.9% of the accuracy. See Gru and the Minions in action below, 🔉on please (h/t @cartesia)!
41
165
37
631
193,896
NYC x AI scene on 🔥🔥 Amazing turnout this am for @bagelsAI cohosted with @swyx in advance of the @aiDotEngineer summit tmrw!
2
5
1
45
5,529
bagels.ai retweeted
Got talked into giving a DeepSeek talk this afternoon simons.berkeley.edu/workshop… Not sure I have anything new to say here! But good excuse for me to read all the blogs.
10
50
3
464
37,298
Very happy to announce that we are open-sourcing the π₀ model, weights, and some fine-tuned checkpoints! Hoping this leads to lots of great follow-up research: github.com/Physical-Intellig… Here is a fun test from our friends at UPenn.
25
112
14
805
72,647
DeepSeek's censorship is no match for the jailbreakers of Reddit (from u/JimRice18)
679
3,220
615
31,937
2,632,888
bagels.ai retweeted
a second DeepSeek paper has hit the internet
53
463
37
5,471
320,086
bagels.ai retweeted
Guys I’ve been doing some reading and I’ve discovered something that might crash the *entire* tech industry(!) Apparently Taiwan can manufacture transistors far cheaper than American companies, and they’re going to drop the price >50x over the next 10 years. Short everything.
23
15
2
499
51,004
aaannnd CoRNStack has been accepted to ICRL check out the great work lead by Revanth and my former intern Tarun: gangiswag.github.io/cornstac…
Excited to announce🌽CoRNStack, comprising high-quality contrastive text-code data created in collaboration with @nomic_ai. Project Page: gangiswag.github.io/cornstac… Our CodeRankEmbed model trained using CornStack achieves state-of-the-art performance on code retrieval tasks! 🧵👇
1
13
660
finally, a perfect billboard for soma
5
11
2
134
14,683
“what would jesus do?” is prompt engineering
11
16
4
319
9,152
If you want to read more about the curriculum training used in OLMo 2 checkout our (@mansiege @_BrettLarsen Sean Owen) paper! Congrats on the release to everyone at AI2! (but especially @soldni and @kylelostat <3 data ) arxiv.org/abs/2406.03476
Super excited to announce our best open-source language models yet. OLMo 2. These instruct models are hot off the press -- finished training with our new RL method this morning and vibes are very good. OLMo 2 introduces a new family of 7B and 13B models trained on up to 5T tokens, representing the best fully-open language models to date. These models sit at the Pareto frontier of performance and training efficiency, with OLMo 2 7B outperforming Llama-3.1 8B and OLMo 2 13B outperforming Qwen 2.5 7B despite lower total training FLOPs. Key improvements include: 1. Enhanced architecture with RMSNorm, QK-Norm, auxiliary Z-loss, and rotary positional embeddings 2. Two-stage curriculum training approach using OLMo-Mix-1124 and Dolmino-Mix-1124 3. Model souping technique for final checkpoints (aka merging) 4. State-of-the-art post-training methodology from Tülu 3 with a three stage training of instruction tuning, preference tuning with DPO, and our new reinforcement learning with verifiable rewards (RLVR) 5. Evaluated on the OLMES suite 6. The Instruct variants are competitive with the best open-weight models, with OLMo 2 13B Instruct outperforming Qwen 2.5 14B instruct, Tülu 3 8B, and Llama 3.1 8B instruct models. The 13B Instruct version builds on our Tulu 3 Recipe with a very finetunable base model and makes for a great user experience that we haven't seen before with the open-source models. Links below :D
1
8
49
8,622