Sinclair Schuller (@sinclairx) header
Sinclair Schuller (@sinclairx) profile picture

CTO @GroqInc. 2x co-founder (Apprenda & Nuvalence - acq. by @EY). Distributed systems. @RPI alum. Outdoors often.

New York, USA
Joined April 2007
Photo by Sinclair Schuller (@sinclairx)Photo by Sinclair Schuller (@sinclairx)Photo by Sinclair Schuller (@sinclairx)Photo by Sinclair Schuller (@sinclairx)Photo by Sinclair Schuller (@sinclairx)Photo by Sinclair Schuller (@sinclairx)Photo by Sinclair Schuller (@sinclairx)
Sinclair Schuller retweeted
Fast tokens are just a different product. Good to see that reflected.
We just shipped our biggest improvement to our provider router since the founding of OpenRouter. Before, we prioritized mostly based on price. The new router now rewards the best quality inference for the actual cost of a request, so requests stay cheap but are also fast and reliable. Providers that deliver more value automatically win more traffic, so every provider has a reason to keep improving. And every time a provider gets better, so does your inference on OpenRouter.
1
1
2
207
A big fund to fuel big ambitions! Way to go @disruptivetech !
Today, we announced the Disruptive Flagship Fund, a $10 billion fund designed to scale the firm’s selective approach to backing category-leading private technology companies. Advances in artificial intelligence, the massive buildout of compute infrastructure, and a new era of investment in defense and national security are creating companies of unprecedented scale and strategic importance. The amount of capital required to capture these opportunities is increasing significantly. Disruptive was built for this moment. Since its founding in 2012, the firm has developed an investment model designed to identify a small number of exceptional companies and deploy significant capital behind them. Disruptive’s investment approach remains unchanged and the firm plans to back approximately 10 exceptional growth and late-stage companies, investing up to $1 billion per company. Alex Davis, Founder and CEO of Disruptive commented: “The best private technology companies are growing larger, staying private longer and requiring more capital than ever before. We have always focused on a small number of exceptional companies, building the conviction and relationships to be there for founders at their most important moments. The Disruptive Flagship Fund gives us the scale to match the opportunity.” Press release: prnewswire.com/news-releases… Bloomberg: bloomberg.com/news/articles/… Forbes: forbes.com/sites/giacomotogn…
90
And I'm betting that there's an inverse token consumption pyramid showing those 5,000 people consuming, by far the most tokens, and the 1 to 2 billion people consuming far fewer. And I'm not talking just on a per capita basis. Or if the consumption pyramid doesn't look that way right now, it will very soon.
2
122
“Nvidia’s performance advantage is so great that even if the competitor chip hardware was sold for free (but with providers still of course paying for datacenter hosting and power and other operating costs), cost per token would still be cheaper when using Nvidia.”
5
243
What an amazing journey Groq is on. From creating a blazing fast inference chip to building the world's premier, at scale inference cloud We're just getting started. Thanks for your partnership, @nvidia & @Dell
The next wave of AI is about deploying incredible innovation at massive scale. Excited to work with @GroqInc and @nvidia to make that happen with @Dell. 🚀 nitter.cf/GroqInc/status/2091908…
1
1
24
2,671
The "Price-per-task vs price-per-token" section Is an example of why obsessively focusing on token cost is idiotic. You have to measure models at a higher level of abstraction to really understand their performance as well as their clock speed. It's kind of like measuring a vehicle exclusively on an MPG basis: both a Ferrari and Escalade have the same MPG, but one moves more people per gallon of gas used. P databricks.com/blog/benchmar…
67
My dad grew up in Romania, under one of the world's most oppressive communist regimes. When I was a kid, he would always say "America is the best country on Earth". He wasn't wrong. Thanks for being America, America. Happy 250th
1
4
115
For those of us with hyperactive inner monologues, we can totally understand how an LLM-based conversation protocol can control action and activity in the real world: reddit.com/r/Damnthatsintere…
180
Happy Thanksgiving, all. I'm thankful for the tremendous amount of Black Friday spam and how today serves as the ultimate 'unsubscribe' reminder.
220
Sigh...I know. It makes sense in my head, but not in written form
36
Warning, this is a mouthful: AI is the wholesale outsourcing of the crowdsourcing of anything crowdsourcable from a limited population with limited capacity for cognitive work (people) to an unlimited population with unlimited capacity for cognitive work (agents)
1
1
2
324