LLMLearner (@LLMLearnerAI) header
LLMLearner (@LLMLearnerAI) profile picture

LLM benchmarks, pricing & model intelligence. Finding the interesting numbers behind frontier AI.

England, United Kingdom
Joined June 2025
Photo by LLMLearner (@LLMLearnerAI)Photo by LLMLearner (@LLMLearnerAI)Photo by LLMLearner (@LLMLearnerAI)Photo by LLMLearner (@LLMLearnerAI)Photo by LLMLearner (@LLMLearnerAI)Photo by LLMLearner (@LLMLearnerAI)Photo by LLMLearner (@LLMLearnerAI)Photo by LLMLearner (@LLMLearnerAI)Photo by LLMLearner (@LLMLearnerAI)Photo by LLMLearner (@LLMLearnerAI)
Seeing all the Opus 5.5 motion design videos lately, I had to try one too. I gave Claude our site — llmlearner.com — and asked it to turn the site into a 15-second launch film. Here’s how it turned out 👇 All rendered from code: HTML → headless Chrome → FFmpeg.
1
1
113
DeepSeek has released a new feature in DeepSeek Harness that enables users to instantly create plugins, games, and designs. Well done!
Your Harness. You Define It. Meet Creator Mode in DeepSeek Harness. Turn ideas into plugins that you can use, from a design workspace to a sandbox game or a 3D LLM visualizer. What will you create?
25
So Fable 5.5 is coming
Mythos 5.5 is already listed HTML source code of Anthropic's official website Thanks to the anonymous person who sent me the tip via email :)
38
OpenAI is merging ChatGPT and Codex usage limits into one shared pool starting in December. That could be bad news for ChatGPT Plus users who rely heavily on Codex. I went through my own Codex usage logs to see how fast it actually burns through the limits. Here's what I found
1
35
Codex usage on Plus: • GPT-6 Astra: 20.9% of the 5-hour quota per task • GPT-6.1 Sol: 6.1% per task That's just ~5 Astra or ~16 Sol tasks to exhaust the entire 5-hour allowance, ignoring resets. Unless the shared quota increases, Plus could become very limiting.
1
234
OpenAI seems to be giving up on the $20/month Plus membership—it has almost no advantages left. The usage quota is very limited and can hardly compete with Claude's. GPT-6.1 isn't as good as Opus 5.5, and the weekly usage limit is much lower than Claude's. Strange strategy 🤔
1
8
Serious issue with GPT-6.1 Terra in Codex: very lazy! Asked it to search all it could on Gemini 4 Carbon and save it. It did basics + benchmarks, stopped, said only basics were saved. Told it to continue; it stopped again after reformatting. It stopped 4 times before finishing.
2
11
GPT-6.1 Sol is impressively efficient. We collected task-level cost data from 24 matched benchmark comparisons against Sonnet 5.5. Both models have the same API pricing. However: • Lower cost in all 24 comparisons • 81.7% lower geometric-mean task cost • Up to 19.4× cheaper
2
1
20
A striking result in the new AA Index 5.0: GPT-6.1 Sol (max): 54.5, $1.27/task Claude Sonnet 5.5 (max): 54.2, $10.02/task Nearly the same score, but Sonnet costs ~7.9× more per task. On v4.3, Sonnet was ahead by 4.2 points. The new index flipped the order. Interesting~
1
16
LLMLearner retweeted
poteto.com has landed
1,894
393
694
12,777
5,028,873
We built a visual breakdown of Anthropic's IPO S-1 on LLMLearner: llmlearner.com/providers/ant… The numbers are remarkable: • H1 2026 revenue: $16.3B (14x YoY) • Q2 operating profit: $974M • H1 net loss: $80.7B • Operating cash flow: +$3.93B Key findings 🧵
Anthropic has filed an S-1 registration statement with the SEC related to its proposed IPO. Read more: anthropic.com/news/s1-sec Legal disclaimer: A registration statement relating to these securities has been filed with the SEC but has not yet become effective. These securities may not be sold, nor may offers to buy be accepted, prior to the time the registration statement becomes effective. This post does not constitute an offer to sell or the solicitation of an offer to buy these securities, nor shall there be any sale of these securities in any state or jurisdiction in which such offer, solicitation or sale would be unlawful prior to registration or qualification under the securities laws of any such state or jurisdiction.
1
19
5/6 Anthropic is buying NVIDIA GPU compute from SpaceXAI—a SpaceX subsidiary Contracts total UP TO $120.5B through 2029. At full delivered capacity (expected Dec 2026), fees would be ~$3.1B/month. After early 2027, deals have 90-day cancellation terms.
1
3
6/6 Claude wrote over 90% of contributions to Anthropic's own codebase in September 2026. Daily code volume per engineer increased more than 45x vs 2024. That's code volume, not a 45x productivity claim. Still remarkable.
3
LLMLearner retweeted
Thanks @LLMLearnerAI for adding the agent-focused CyberGym category after our data note. Lyrie Agent now correctly listed at 99.2% — top reported agent score, separate from model rankings. Official source: cybergym.io
1
1
65
Maybe we can see the full scores versus cost for Terminal Bench 4.0 here. Clearly, Kimi K3.1 Pro is more expensive than GPT-6.1 Sol but performs better. Source : llmlearner.com/rankings/term…
hmmm something smells too good to be true here
13
First, persistent prompt caching. Now, switching reasoning effort without cache invalidation. It feels like OpenAI is making cache management increasingly independent of conversation settings. Is this mostly clever prefix management, or something deeper at the KV cache layer?
Day 19/ Small updates. Calls connect much faster for dots, changing reasoning in codex & work mid conversation does not invalidate cache anymore and a we've also updated the codex cli.
14
Confirmed! Thariq left Anthropic!
I’ve left Anthropic after more than a year of working on Claude Code and seeing it scale larger than I ever imagined. I have really loved working at Ant and believe deeply in the mission, and most of all, the idea of a race to the top. The idea that if we work hard and responsibly, we can raise the bar and inspire others to great outcomes. And if we all push each other to be better, things can be radically good. I will carry the spirit of this with me forever. My colleagues at Anthropic are the most talented, thoughtful, competent, and earnest people I have ever met. I am glad they are at the wheel and trust them deeply. To the community on X, thank you for everything. You’ve made this the most fun (and sometimes stressful) job I’ve ever had. For me, it is time for a bit of a break before diving into something new. If you want more excellent Claude Code content, you should follow @addyosmani , @lydiahallie, @_catwu, @ClaudeDevs and of course @bcherny who started it all.
10