
Investing in data/cloud infra @ScaleVP. Host https://nitter.cf/t.co/HNnTtkWgWl. Previously PM @GoogleCloud, @AWScloud. Member @Ch_JesusChrist.
Mountain View, CA
Joined February 2009
- Tweets1.6K
- Following1.1K
- Followers1.3K
- Likes773
These providers rely on a layer of GPU operators. Unsurprisingly, those are booming as well. Modal alone has added 14 GPU operators (75% of its supplier base) in the last 6 months. That's all I'll say about them. This thread is all about the inference providers- I'll do an analysis on the GPU operators soon
21
Who are they using to run those models? I didn't expect to see so Groq top the list. Baseten, Fireworks and Modal are right behind. In a two week period, Baseten added 6 customers (jumping ahead of Fireworks) and OpenRouter added 5 (double in a month!)
1
39
After the AI-natives, it is dev tools and data companies. In general, there is a little bit of correlation, the more a category consumes AI, the more they go open. I was suprised to see security score low here
1
15
Who is going open? In general it is the fastest growing AI companies (those listed "new" are moves in the month of July). Notice they aren't leaving Anthropic or OpenAI. This fits the narrative that open models are used for specific use cases alongside frontier capability
1
17
Yet the quickest category growing now, are the inference providers (powering open source models). What used to be just once or twice a year: now a major app is adding an inference provider every other day (11 in the first 3 weeks of July).
1
1
61
Apps sometimes disclose what clouds they use. I looked at 2,609 docs. Unsurprisingly, the most commonly mentioned are the clouds (1-Amazon, 2-Google, 5-Microsoft), but interestingly, the frontier labs are already catching up (3-OpenAI 6-Anthropic)
1
1
87
Who is moving to open models and how?
I analyzed docs from 2600 companies: and yes, it is happening and fast...
1
2
152
there has never been a job market like this one
unemployment really only move two ways:
Quick rise (recession)
Slow fall (growth)
Since '23 its been neither: slow rise
anyone know why?
1
3
170
.@opentelemetry is eating observability! 2024 was its breakout year. Search traffic went from 0 -> more than some of the big vendors
Does your stock needs some AI juice? There's a GPT for that (generates earnings call AI claims) chat.openai.com/g/g-vZqDou6H…
Replying to @planepowers
If you are referring to "topics" I see these three: github.com/topics/project-ma…
5
1,954














