
founder + chief script kiddie @bagels.ai, a 🥯2🥯 (b2b) llm gen ai startup in stealth | cofounder of loxML (acq. 2020) | ex-OpenAI (catering) | 🤖+🥯=🦾
NYC
Joined July 2023
- Tweets551
- Following600
- Followers344
- Likes905
bagels.ai retweeted
a lot of sf startups work 996 bc deep down they know they’re not building anything differentiated. speed is the only edge left when you’re making the 57th lovable for excel.
bagels.ai retweeted
"Mom, how did we get so rich?"
"Your father democratized access to private equity for retail investors to find exit liquidity for trillions of dollars worth of unsellable assets, sweetheart. Eat your Cheerios"
bagels.ai retweeted
Thank you crowd worker number 48734 from crowd working company [REDACTED] for your gift of this data sample that has been (re)sold in its entirety to all the LLM shops for $128/hr
bagels.ai retweeted
our first 2 speakers @airstreet nyc ai meetup on 4/15
- @tylerangert of @patinasystems, spontaneous software, formerly of @replit
- @ashedwardst of @fern_labs, multi-agent systems to write software, formerly of @palantirtech
+2 more coming soon!
rsvp: airstreet(dot)com/nycai
bagels.ai retweeted
Shout out to that one Anthropic employee who is really good at acquiring bioweapons
bagels.ai retweeted
How can we use small LLMs to shift more AI workloads onto our laptops and phones?
In our paper and open-source code, we pair on-device LLMs (@ollama) with frontier LLMs in the cloud (@openai, @together), to solve token-intensive workloads on your 💻 at 17.5% of the cloud cost while maintaining 97.9% of the accuracy.
See Gru and the Minions in action below, 🔉on please (h/t @cartesia)!
bagels.ai retweeted
NYC x AI scene on 🔥🔥
Amazing turnout this am for @bagelsAI cohosted with @swyx in advance of the @aiDotEngineer summit tmrw!
bagels.ai retweeted
Got talked into giving a DeepSeek talk this afternoon simons.berkeley.edu/workshop…
Not sure I have anything new to say here! But good excuse for me to read all the blogs.
bagels.ai retweeted
Very happy to announce that we are open-sourcing the π₀ model, weights, and some fine-tuned checkpoints! Hoping this leads to lots of great follow-up research: github.com/Physical-Intellig…
Here is a fun test from our friends at UPenn.
bagels.ai retweeted
DeepSeek's censorship is no match for the jailbreakers of Reddit
(from u/JimRice18)
bagels.ai retweeted
Guys I’ve been doing some reading and I’ve discovered something that might crash the *entire* tech industry(!)
Apparently Taiwan can manufacture transistors far cheaper than American companies, and they’re going to drop the price >50x over the next 10 years.
Short everything.
bagels.ai retweeted
aaannnd CoRNStack has been accepted to ICRL
check out the great work lead by Revanth and my former intern Tarun: gangiswag.github.io/cornstac…
Excited to announce🌽CoRNStack, comprising high-quality contrastive text-code data created in collaboration with @nomic_ai.
Project Page: gangiswag.github.io/cornstac…
Our CodeRankEmbed model trained using CornStack achieves state-of-the-art performance on code retrieval tasks!
🧵👇
bagels.ai retweeted
If you want to read more about the curriculum training used in OLMo 2 checkout our (@mansiege @_BrettLarsen Sean Owen) paper!
Congrats on the release to everyone at AI2! (but especially @soldni and @kylelostat <3 data )
arxiv.org/abs/2406.03476
Super excited to announce our best open-source language models yet. OLMo 2.
These instruct models are hot off the press -- finished training with our new RL method this morning and vibes are very good.
OLMo 2 introduces a new family of 7B and 13B models trained on up to 5T tokens, representing the best fully-open language models to date. These models sit at the Pareto frontier of performance and training efficiency, with OLMo 2 7B outperforming Llama-3.1 8B and OLMo 2 13B outperforming Qwen 2.5 7B despite lower total training FLOPs.
Key improvements include:
1. Enhanced architecture with RMSNorm, QK-Norm, auxiliary Z-loss, and rotary positional embeddings
2. Two-stage curriculum training approach using OLMo-Mix-1124 and Dolmino-Mix-1124
3. Model souping technique for final checkpoints (aka merging)
4. State-of-the-art post-training methodology from Tülu 3 with a three stage training of instruction tuning, preference tuning with DPO, and our new reinforcement learning with verifiable rewards (RLVR)
5. Evaluated on the OLMES suite
6. The Instruct variants are competitive with the best open-weight models, with OLMo 2 13B Instruct outperforming Qwen 2.5 14B instruct, Tülu 3 8B, and Llama 3.1 8B instruct models.
The 13B Instruct version builds on our Tulu 3 Recipe with a very finetunable base model and makes for a great user experience that we haven't seen before with the open-source models.
Links below :D













































