Our "Beyond Neural Scaling laws" paper got a #NeurIPS22 outstanding paper award! Congrats Ben Sorscher, Robert Geirhos, @sshkhr16 & @arimorcos awards: blog.neurips.cc/2022/11/21/a… paper: arxiv.org/abs/2206.14486 🧵 nitter.cf/SuryaGanguli/status/15…

uni student life

One of many lives deliveries happening autonomously with DoorDash Dot today. After the food’s placed, Dot makes sure nothing’s missing (this part can be faster). Then off to the races! 🏁 Dot is rapidly improving through these live orders happening everyday.

TMLR has faced a deluge of submissions, necessitating stricter desk rejection policies due to limited reviewer capacity Co-EiC Nihar Shah reached out to authors of 10 papers slated for desk reject. Could they answer questions about their *own* submission? medium.com/@TmlrOrg/asking-a…

Six degrees of Yann LeCun We mapped the coauthorship graph of every AI researcher on arXiv 🚀 Enter any two names to find the shortest path of papers connecting them What’s your @ylecun number? alphaXiv.org/number/@yann-le…

After co-inventing ChatGPT, I kept asking myself: why have superhuman chat models not led to AGI? I’ve spent the last 2 years in stealth building a new way to train models (RLCD), and a new type of frontier AI model that we are releasing today: Jev • 20-200x faster • 40-400x cheaper (w/ output tokens free) • Frontier composable intelligence optimized for decisions AFAICT the shortest path to AI-based economic revolution

We’re sharing a solution to the Navier-Stokes Millennium Prize Problem, one of the deepest problems at the frontier of mathematics. The proof was produced by a group of agents, using an OpenAI next-generation model significantly more capable than GPT-6 Astra. The problem concerns whether the description of smooth three-dimensional fluid motion modeled by the Navier-Stokes equations can break down. It has remained unresolved for roughly 90 years.

I deleted my previous post. I'm just going to post the entire statement page by page. It's a complicated situation. Statement: cims.nyu.edu/~tristanb/state… cims.nyu.edu/~tristanb/euler… cims.nyu.edu/~tristanb/ipm.p… cims.nyu.edu/~tristanb/bouss… github.com/tristanbuckmaster…

Over 300 original figures! An Illustrated Guide to AI Agents is now OUT on Kindle and other Ebook stores! Presses are rolling, print copies ship in a few weeks. @MaartenGr and I spent the last year and a half making the agent stack legible: memory, tools, planning, evaluation, multi-agent systems, and code agents. We're ecstatic to finally be able to share it with you! Agents are being adopted faster than they're being understood. Our bet is that a small number of concepts will outlast everything else in this field, so we spent the time identifying them and explaining them properly. Concepts and code. You build a working agent yourself along the way. Order here: Amazon: amazon.com/Illustrated-Guide… O'Reilly: oreilly.com/library/view/an-…

Little bit of a personal update in that it's been a year at Mistral, and I'm leaving soon. Interesting times focused on post-training engineering, which was actually new to me, some thoughts in thread

Rumour has it that @axiommathai essentially scooped Stadlmann, initially reaching out and suggesting writing a paper together but then disappearing and going full-on competition mode. Her postdoc mentor works at axiommath so likely knew about her ideas. Anyone knows details?

I turn 50 today. This is a message to my kids but I offer it to you in case any of it rings useful. I was born in Sri Lanka in 1976 in a country that, at the time, was about to enter a decades long civil war. My father was able to get stationed at the Sri Lankan High Commission in Canada for four years in the early 80s - when some of the fighting was most severe - and which from our vantage point in Canada gave us some respite from an otherwise omnipresent conflict. He came as a diplomat but then my father filed for refugee status after four years when his life was threatened by militants. We stayed in Canada as refugees. My dad never really landed on his feet and we grew up on welfare. My mom stepped up. She did an incredible thing and put our family on her back and kept marching forward. Sometimes the steps were very small but she always tried to keep moving forward. I worked at Burger King starting at 14, giving my paycheck to my mom and dad to support our family in the role that I was assigned - earn enough to pay for our bus passes because we couldn’t afford a car. I was a loser growing up. Some friends, some good memories but mostly forgettable and lonely. I wasn’t very studious but did get my act together in my final year and got into a great university. I immigrated to the US soon after graduating and found an opportunity. Things clicked and I have been traveling a path to find myself ever since. Only in America is this possible… I worked hard, followed the rules, paid my taxes and stayed in California out of loyalty for the opportunities it has given me despite its dysfunction. I found my wife here. Had my kids here. Found my tribe here. There have been some very hard times as well - deaths, divorce, financial pain, mistakes of omission and mistakes of commission. You can’t dwell on these things - they are weights that will pull you down if you’re not careful. Learn from them. Respect them. BUT MOVE ON. To think 50 years ago I could have ever gotten a chance to meet the people I’ve met and have had the experiences I’ve had would have been mind boggling to my parents. It’s mind boggling to me now. We forget often and try to convince others it’s not true but America truly is the best country in the world. Everything and anything is possible here. I can testify. Be grateful to be here. This is the only place that gives EVERYONE a chance to live a great adventure. The first 50 years have been that for me - an incredible adventure. Notice there is nothing here about accomplishments or money. Because it doesn’t matter and it won’t matter. You will be dust in less than 100 years from now and the decision to be remembered won’t be yours so stop sweating it. It’s not in your control. So what is in your control? Be kind. Have fun. Work on something meaningful to you. Find your tribe. Try to find perspective. Find an incredible partner. Have a bunch of kids. Live an adventure. Forgive your parents - they were doing the best they could even if that wasn’t what you deserved. I will do what I can to make my next 50 years a wild ride. You should too. I love you and thank you. ❤️ 🙏🏽🙏🏽

This was actually so much fun!!!Shoutout to @aliasaria from @transformerlab as well as @mahab_8, Xin Lei Lin, and Gian Favero from @ideogram_ai for presenting

this feels pretty surreal ngl

We created a pitch deck to tell a handful of VC firms about us and what we were up to (a fun experience!). Here’s a few slides about our background and some of the things we’ve worked on from the pitch deck (it was fun putting together the list of people in our teams who have gone on to found a whole range of exciting companies). We are delighted to have selected @radicalvcfund and @khoslaventures to lead our initial funding round, along with participation from @lightspeedvp, @kleinerperkins, Doerr Capital (@johndoerr), and Alphabet (@Google). We’ll be working with them to close our seed round over the next few weeks.

when someone has a meteoric rise everyone thinks it’s alpha but it’s more likely to be leveraged beta

policy gradient updates arriving out of sync with model rollout

Big news: Kimi-K3 by @Kimi_Moonshot is now #1 in the Frontend Code Arena with 1679 pts, surpassing Claude Fable 5. This is a 17-place jump from Kimi-k2.6 (#18 -> #1). In Frontend, Kimi-K3 ranked #1 in 6 of 7 domains: Brand & Marketing, Reference-Based Design, Data & Analytics, Consumer Product, Simulations, and Content Creation Tools, landing #2 only in Gaming behind Fable 5. The full model weights will be released by July 27. Congrats to the @Kimi_Moonshot team on this major milestone!