Elostirion (@lostirion) header
Elostirion (@lostirion) profile picture

AI Builder | OSS local AI enthusiast 🚀 Solving hard problems on my own terms.

Spain
Joined April 2021
Photo by Elostirion (@lostirion)Photo by Elostirion (@lostirion)Photo by Elostirion (@lostirion)Photo by Elostirion (@lostirion)Photo by Elostirion (@lostirion)Photo by Elostirion (@lostirion)Photo by Elostirion (@lostirion)Photo by Elostirion (@lostirion)Photo by Elostirion (@lostirion)Photo by Elostirion (@lostirion)
I stopped using Ollama many months ago because it doesn't offer good performance. But, without a doubt, we should all learn how to create products that are this easy to use. They did a great job.
1
48
Inkling 2 Small is a large model, and it's a weird one 594B parameters, 17B active, and only ~13% on Terminal-Bench 4.0 Qwen3.8 Flash Next has 6B active parameters (125B backbone) and scores 29% on the same benchmark. In my own runs, it solved nearly 50% of the tasks with 4 attempts at xhigh. Now the weird part: on DeepSWE v1.1, Thinking Machines reports 72.1% for Inkling 2 Small. Qwen3.8 Flash Next sits around 50%. So Inkling 2 Small handles long repo-level software engineering far better than a much smaller model, then struggles in a terminal.
20
7
163
12,897
Elostirion retweeted
Replying to @bnjmn_marie
I suppose the problem resides in context length. Qwen has 256K as default, and Inkling has 1M. This is important for long running tasks, like DeepSWE ones. I ran DeepSWE 1.1 with Qwen3.8-Flash-Next with 1M (with RoPE) , and it got 59,1% Also this benchmarks doesn’t test all the reasoning levels. It’s a shame, but this benchmarking companies don’t really bother to configure the model correctly before testing it.
1
5
436
Elostirion retweeted
Local AI. Local compute. Open weights. Open source. Global collaboration.
680
1,502
217
16,908
390,819
NVIDIA is preparing a new inference service for SM120/SM121: NVIDIA/hyperflare-inference It's still in development, but it just looks awesome.
49
Esto de confundir causa con efecto es muy humano, ¿no te parece? @nudpiedo
Un profesor recopiló 50 años de estudios sobre quién triunfa. Su conclusión incomoda: casi todo lo que crees del éxito es consecuencia, no causa. 8 verdades incómodas 🧵
1
1
1
142
Elostirion retweeted
What they are afraid of is us having sovereignty.
8
13
1
168
6,166
Elostirion retweeted
Spanish is easy #meepcat
128
1,813
141
10,653
308,075
215
5,523
331
32,014
523,835
Voice assistants would be completely local, or bust.
There is a lot of work to do with voice assistants yet. The emotion-identification capability that Qwen is developing is essential; furthermore, in the future, it will also be crucial for a video camera to record the user in order to detect their facial and manual gestures.
32
There is a lot of work to do with voice assistants yet. The emotion-identification capability that Qwen is developing is essential; furthermore, in the future, it will also be crucial for a video camera to record the user in order to detect their facial and manual gestures.
When someone sighs "I'm so tired today," the right reply isn't just about the words. You also have to hear the fatigue in their voice, then figure out if they want to vent, need comfort, or actually need help. The same "I'm fine" can mean completely different things depending on how it's said. To improve the empathy and persona ability of Qwen-Audio-3.1-Realtime, we built a training scheme that combines semantic understanding, emotion perception, empathy strategy, and persona expression.
1
66
If this benchmarks are lawful, this model beats GLM-5.3-Flash, but being smaller and probably faster.
ERNIE 5.5 Flash Preview just landed! 🔥 Built on a new architecture designed for efficient inference, the latest open-weight foundation model in the ERNIE family delivers stronger performance in coding, 3D modeling, knowledge work and content creation. It keeps decoding fast while posting competitive scores on Terminal-Bench, AutomationBench, and other benchmarks. Here's the rundown: - 280B total parameters, 14B active per token - 1M-token context window - Generation speed above 200 tokens/sec Model weights will be released by November 25.
1
60
All the code benchmarks I’ve run share the same flaws: - They use a generic harness. - They fail to account for the model’s levels of reasoning. - They impose strict time limits. - They assign a score of 0 to a test that was nearly successful. - They set context limits that are lower than what the model can actually handle. That is why we often notice, when using these models, that they do not align with the published benchmarks.
28
The becoming of the wait.
24
Today I went to the medic… and once more, I prefer being treated by LLMs.
21
Elostirion retweeted
To the massive dismay of those looking to control compute, it's way too late. CPUs and GPUs are everywhere. Models will get smarter, algorithms will get better, and bottlenecks we used to believe in will be overcome. You will lose and the Internet will remember what you did.
24
108
10
1,371
36,219
I also want a Chinese model.
25
Elostirion retweeted
My first open-source contribution: a mixed NVFP4 + FP8 quantization of @NousResearch's Arete-27B, following NVIDIA's own recipe. • MLP + lm_head → NVFP4 (4-bit, block-16 scales) • Attention → FP8 (W8A8) • Embeddings + vision tower → BF16 • 55 GB → 20 GiB, single RTX PRO 6000 Verified against NVIDIA's reference checkpoint (1,699 quantizers, 0 diffs), then benchmarked BF16 vs quantized side by side: MMLU 84.1 → 83.1 (−1.0) GSM8K 60.7 → 62.6 (+1.9) IFEval unchanged Quantization with measurement, not faith.
2
1
2
134
My first open-source contribution: a mixed NVFP4 + FP8 quantization of @NousResearch's Arete-27B, following NVIDIA's own recipe. • MLP + lm_head → NVFP4 (4-bit, block-16 scales) • Attention → FP8 (W8A8) • Embeddings + vision tower → BF16 • 55 GB → 20 GiB, single RTX PRO 6000 Verified against NVIDIA's reference checkpoint (1,699 quantizers, 0 diffs), then benchmarked BF16 vs quantized side by side: MMLU 84.1 → 83.1 (−1.0) GSM8K 60.7 → 62.6 (+1.9) IFEval unchanged Quantization with measurement, not faith.
2
1
2
134
Weights, full model card, benchmark table and reproducible pipeline: huggingface.co/veladan/Arete… Apache-2.0. Base model by @NousResearch. vLLM ≥ 0.29 / TensorRT-LLM, Blackwell GPUs.
39