
covering AI news, working on @voxelbench
Joined October 2018
- Tweets3.6K
- Following958
- Followers15.6K
- Likes43.9K
Some new Claude models have recently entered early testing.
A newer Fable checkpoint + new Opus
h/t to kostikz on discord for these Fable outputs:
Carbon is a nice improvement over Argon
I did not like Argon at all, while Carbon has reduced slop, plus it's more careful now and adheres to constraints better
but google should seriously consider adding xhigh and max reasoning levels
make use of that 1M output token limit!
Legit retweeted
Introducing Gemini 4 Carbon, it's a big jump over Argon which we released just 2 weeks ago.
Gemini 4 Carbon is SOTA on cyber, long horizon tasks, ranks #1 on Artificial Analysis V5, significantly improves on usability in domains like coding, and is more aligned.
Legit retweeted
Anthropic has filed an S-1 registration statement with the SEC related to its proposed IPO.
Read more: anthropic.com/news/s1-sec
Legal disclaimer: A registration statement relating to these securities has been filed with the SEC but has not yet become effective. These securities may not be sold, nor may offers to buy be accepted, prior to the time the registration statement becomes effective. This post does not constitute an offer to sell or the solicitation of an offer to buy these securities, nor shall there be any sale of these securities in any state or jurisdiction in which such offer, solicitation or sale would be unlawful prior to registration or qualification under the securities laws of any such state or jurisdiction.
Legit retweeted
Models can seemingly degrade over time.
The following scenes were created with the same prompt and the same model, @GoogleAI's Gemini 3.8 Flash, by a user on DesignArena.
The first was generated just 3 days after release, while the second came almost a month later.
The difference is striking. The first scene features a finished bungalow with terraced gardens, while the second is barely recognizable.
Digging into the code, we find that the second scene still attempts to build the garden, windows, and patio, but buries much of it beneath its own terraces.
In aggregate, the share of objects never visible on camera jumps from 18% to 57%. For bushes, the share placed underground jumps from 0% to 100%, and even the house walls go from fully above ground to 64% below it.
Both scenes share the same simple user request, yet a few weeks after release, the model struggles to fulfill it. Try making your own generations and judge for yourself at DesignArena.ai!
Legit retweeted
Kimi K3.1 Pro has ranked 6th on the VoxelBench Live Leaderboard!
currently tied with Gemini 4 Argon
Legit retweeted
🚨🚨ALERT: ANTHROPIC IS A/B TESTING USAGE LIMITS
Many users on X are reporting LOWER usage limits right now. THEY ARE NOT WRONG. We detected an A/B test going on that DECREASES your monthly API-value by ~20% while INCREASING your 5h usage limits by ~20%. This only affects SOME accounts. (1/2)🧵
Took some screenshots for you all
VoxelBench 2 is now in the final stages of development, beta test coming soon!
Google doesn't let gemini think for more than single digit minutes
Anthropic makes sure claude overthinks
OpenAI makes sure their model ships the sloppiest code on earth that WILL break after a week or 2
Argon is out on VoxelBench
its performance is very uneven; sometimes producing clean and detailed builds, while also often making much less detailed and smaller builds
overall im underwhelmed, but I hope they recognize this gap and improve it fast
one similarity I found interesting (and annoying) between this model and Fable 5.0 is that they both prefer to make smaller builds
but unlike Fable, Argon made no effort to verify that the blocks it placed weren't overlapping or clipping into other blocks
on average, Argon spent 2 minutes per VoxelBench prompt; far below the average of models like Opus and Fable, and even Astra or Sol



























