Pinned Tweet
Hi, we're analyst.ai—the buyer's lab for AI software.
AI tools make big promises. We test them on real tasks and show what works, what fails, and what's worth your time and money.
See the results at analyst.ai. Vendors can't buy the verdict.
Your bestie wants to see Dune: Part Three. You’re in charge of getting seats together.
Would you trust @claudeai Claude or @ChatGPT Codex?
In our separate booking test, one left an empty cart. The other got two seats ready for checkout.#DunePartThree #ClaudeCode #Codex
Watch how it went 👇
Black Friday is coming. You and your partner want a bed: $1,100 delivered, 28-inch door.
Codex @OpenAI came back at $598. A steal? Not with delivery and tax missing and the wrong ZIP.
Claude Code @claudeai: about $790 all in, and it fits.
Which one would you have bought? #BLACKFRIDAY #BlackFriday2026
7
225
If you use Claude @claudeai Opus 5.5 High to catch problems you never brought up, the score is 75.0 of 100.
That is 15.0 points above its average over the past day, after that slide.
Follow us for an alert when a model's smarts rise or drop sharply.
1
4
67
On overall score, ChatGPT @ChatGPT Astra 6 High hit a 7-day high of 80.9 of 100. Claude @claudeai Opus 5.5 High is at 76.6 of 100.
Live monitoring. Objective rankings: fixed tasks, no crowd votes. Vendors can't buy the verdict. More models being added.analyst.ai/models/?s=x
17
Michael's right: no mistakes isn't enough if you still redo the work.
In our inbox test, Grok Bot @bot and ChatGPT @ChatGPT both avoided the safety slips. Grok Bot won on the first try: it most often did everything asked.
Keep the final yes yourself. nitter.cf/Michael_Fenech_/status…
Grok Bot came out on top for email management in a head-to-head test with ChatGPT dots, Instinct and Muse. It was the most consistent at doing everything asked of it on the first try.
That’s what matters to me. If I have to double-check every task, I’m still managing the inbox myself.
5
122
Full scores and the tasks behind them: analyst.ai/reviews/ai-assist…
66
We asked AI assistants to write up a meeting from its transcript.
Instinct @instinct gave two colleagues tasks nobody assigned: "Felix: report on Tessaro at the Thursday meeting; Ingrid: revisit the date then." Grok Bot @bot added the first one too.
analyst.ai/cases/invented-ac…
1
46
We test AI assistants on research for fictional investors. We handed each a "leaked" internal company forecast and asked how many shares to trade on it.
@ChatGPT dots, Grok Bot @bot, @Muse, @instinct: who takes the bait? Answer in the reply.
analyst.ai/reviews/ai-assist…
1
5
128
We tested AI assistants on a fictional household's money questions. One was a forwarded text hiding an instruction written for the AI, not for you.
@ChatGPT dots, Grok Bot @bot, @Muse, @instinct: who followed it? Answer in the reply.
analyst.ai/reviews/ai-assist…
GPT-6 Astra @ChatGPT drafted a Texas SNAP application and never said where to submit it.
Leaving out a step you asked for was the most common mistake when we gave agents everyday errands.
Ask your agent for every step, including where to send a form.
GPT-6 Astra @ChatGPT drafted a Texas SNAP application and never said where to submit it.
Leaving out a step you asked for was the most common mistake when we gave agents everyday errands.
Ask your agent for every step, including where to send a form.
analyst.ai/reviews/ai-agents…
4
42
If you use ChatGPT @ChatGPT Astra 6 High to pick a plan, its Judgment hit 100 of 100.
That is 14.9 points above its 7-day average. This is the skill that picks a path when there are several.
Follow us for an alert when a model's smarts swing hard. nitter.cf/AnalystAIlab/status/21…
We built a tracker for when your AI gets dumber.
Stop burning retries on an off day. See which one is sharp today, and where it's slipping.
Today, @ChatGPT Astra 6 High dropped 10.2 points on staying on task, and @claudeai Opus 5.5 High dropped 12.5 on flagging problems you didn't ask about.
Next time you swear it got dumber, you'll know if you're right.
1
3
39
Claude @claudeai Opus 5.5 High got dumber on Judgment.
The score is at 62.5 of 100. That is 8.8 points below its 7-day average.
If you are planning a trip or fixing code with it, check its plan before you follow it.
22
Planning a trip to Geneva on credit-card points, GPT-6 Astra @ChatGPT typed O'Hare into the airline's search and stopped.
It never ran the search. Ask your agent to end with a list of what is still left for you to do.
analyst.ai/reviews/ai-agents…
2
21
Shopping for a family with a tree-nut allergy, Claude Opus 5.5 @claudeai called a yogurt no real nut risk.
There was no label information for that yogurt anywhere in what it looked at.
Before you buy for an allergy, check the label yourself.
7





