ML Engineer on Twitter to see cool stuff and meet interesting people. Founding Dev at @NousResearch
Joined August 2013
- Tweets1K
- Following282
- Followers1.1K
- Likes2.5K
Jai retweeted
Introducing Arete-27B: Qwen3.8-27B, post-trained to reinforce Western values.
Chinese open models are currently the strongest available, but they ship with state-aligned behavior in the weights. We built an 803-prompt eval across seven value categories, including freedom of expression, democracy, and privacy, and measured how often a model adopts China’s party line.
After fine-tuning on roughly 53 million tokens, Arete-27B's propaganda rate fell from 22% to 1%, in line with the Western models we tested. Its Hermes Bench score shows no significant performance tradeoffs.
The values in an open model are one fine-tune away.
Our eval, weights, and training data are available now along with the full blog post: nousresearch.com/arete
Jai retweeted
Z.ai chief scientist Jie Tang just revealed the training pipeline behind the upcoming GLM-5.5 (32B, 122B, and 256B) during a lecture at Tsinghua University today.
Instead of relying on public datasets, their pretraining pipeline pulls from six separate internal engines:
- Web: 1 trillion pages crawled at ~10B pages/day with PB-scale template clustering
- Documents: 2 billion scientific PDFs parsed through GLM-OCR (4x faster with speculative decoding)
- Books: 50 million books with layout reordering and garbled-text filtering
- Code: 500 million repositories turned into executable tasks with real tests and issue descriptions
- Video: 10 billion videos for long-sequence world knowledge
- Audio: 300 million hours rewritten via ASR into trillions of tokens
Jai retweeted
Releasing the model weights of Kimi K3.1 Pro: huggingface.co/moonshotai/Ki…
We'll keep advancing open intelligence.
Jai retweeted
Kimi-K3.1-Pro is now open-weights
huggingface.co/moonshotai/Ki…
Jai retweeted
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math.
It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training.
We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵
Blog: rikiyat.github.io/blog/weigh…
Readers added context they thought people might want to know
LLM was given weights explicitly as text in prompt and used code/forward passes (per authors' logs) to ablate Qwen looping direction, a known thinking-mode issue per model card. Primarily fixed repetition in that mode, not general 'natively' improving weights/math.
rikiyat.github.io/blog/weight-sp…
github.com/RikiyaT/lm_und…
huggingface.co/Qwen/Qwen3.5-0…
huggingface.co/RikiyaT/Qwen3.…
Jai retweeted
hey sam, your mclaren is only used 5% of the time. this is a terrible allocation of scarce resources. have you considered taking the bus to work
sam: local inference is a terrible allocation of scarce resources
“a lot of people want local inference, and somehow they assume that the problem is solved now because we have open-source models, we're going to be able to run them on our computers, and so we're not going to need all the stuff in the data centre
but from a global allocation perspective, actually it's quite terrible to have everybody, like, have a bunch of the world's limited supply of DRAM sitting in their own computer and being used five percent of the time
you want maximum utilisation in the cloud if you're trying to deal with this very supply-constrained environment
somehow many people's intuition is the opposite of that”
Jai retweeted
delaying this about an hour but it’s still happening! come to Dolores around 4 onwards for free swag 😎
sf friends and fans of @NousResearch !!!
i will be giving out Nous research merch for FREE in Dolores Park, this Friday 10/23 from 3-7pm
i'll also be DJing and hanging out, come get your Nous swag and chat open source models and Hermes Agent with the community ! 😎
Jai retweeted
sf friends and fans of @NousResearch !!!
i will be giving out Nous research merch for FREE in Dolores Park, this Friday 10/23 from 3-7pm
i'll also be DJing and hanging out, come get your Nous swag and chat open source models and Hermes Agent with the community ! 😎
Jai retweeted
We just launched Hermes Index!
This combines the scores of our new HermesBench and 3 other leading and relevant benchmarks for agents to give every Hermes Agent user a way to find both the best model at a given time, as well as the best model at a given price point!
Check it out
Introducing Hermes Index: an average of benchmarks measuring model performance in Hermes Agent.
Our goal with Hermes Index is to better inform users choosing between models and to show labs how they perform in Hermes.
portal.nousresearch.com/benc…
Jai retweeted
Claude Opus 5.5 leads at 63.31 and $4.99 per task.
GPT 6 Astra is second at 56.25 and $11.61.
Sonnet 5.5 follows at 53.14 and $2.82.
At the other end, DeepSeek V4.1 Flash scores 36.91 at $0.26 and Ling 3.0 Flash scores 21.56 at $0.054.
Jai retweeted
really happy to get this index out! huge thanks to @qorprate @yaboilyrical @JSupa15 @morganemoss @phucnhx for all the work and @daytonaio for supporting the eval runs!
special shout out to gemini 3.8 flash for being our best answer leakage detector. not the job we gave it, but very helpful, thank you
Introducing Hermes Index: an average of benchmarks measuring model performance in Hermes Agent.
Our goal with Hermes Index is to better inform users choosing between models and to show labs how they perform in Hermes.
portal.nousresearch.com/benc…
Jai retweeted
Introducing Hermes Index: an average of benchmarks measuring model performance in Hermes Agent.
Our goal with Hermes Index is to better inform users choosing between models and to show labs how they perform in Hermes.
portal.nousresearch.com/benc…
Jai retweeted
You should be able to use smarter models in your agent.
You should be able to use cheaper models in your agent.
You should be able to use local models in your agent.
You should be able to use a different model for every job.
You should be able to switch models in the middle of a conversation.
You should be able to choose what data your agent has.
You should be able to choose what it remembers and what it forgets.
You should be able to choose what computer your agent runs on.
You should be able to run it on a machine that never touches the internet.
You should be able to run it while your laptop is closed.
You should be able to reach it from the apps you already use.
You should be able to choose how your agent thinks.
You should be able to read the prompt it runs on.
You should be able to see every tool it has, and turn off the ones you don't want.
You should be able to teach it something once and never explain it again.
You should be able to know what it did, and when, and why.
You should be able to export your agent.
You should be able to read the code.
You should be able to change the code.
Your agent should be yours.
Jai retweeted
i just realized, for the rest of my life i’m gonna talk to ai more than i talk to people
Jai retweeted
All these "AI has eliminated the need to study math" takes are just noisy midwittery. In fact, never has it been more important to study math & develop your mind.
