I guess same as sarvam
Mukesh Firoda retweeted
Voice agents still don’t understand who’s speaking to them. That’s a huge gap compared with humans, hidden by all the “phone-call” demos. But that changes today!
NVIDIA is open-sourcing Nemotron 3 Diarization: a model that can reliably track speakers in live conversations, under a commercial-friendly license! In my tests, the quality is really good with one-second speech chunks. So we can use it for voice agents!
I tested it with Reachy Mini and speech-to-speech running on a DGX Spark. It’s super fun to see the robot notice a new voice, ask for a name, and remember it.
The model has day-zero integration with Transformers!
Kudos to the NVIDIA team for shipping useful tools for the whole community!
We’re proud to sponsor Open Together, a free community event hosted by @huggingface on Friday, October 16, to kick off Open Source AI Week in SF.
The evening is split into two parts:
➡️ 6PM – 9PM: 36 live community demos, food, drinks, and time to connect with open-source builders
🪩 9PM – 12AM: Full dance floor with live DJ sets
Doors open at 6 PM, and the first 500 people through the door get collectible HF swag. 🤗
RSVP: luma.com/opentogether
Mukesh Firoda retweeted
Trained a Jev-style classifier on @huggingface Jobs for ~$1.50.
It's a 194M GLiNER2 model that suggests task tags for any Hub dataset from its column names and first row, and returns a label with a probability.
Zero-shot, GLiNER2's first suggestion matched an owner's tag 10% of the time. After 17 minutes of fine-tuning: 69%. The fine-tuned model runs on a free CPU in about a second.
Owners' tags are noisy, so some "wrong" answers are tags the owner left out.
The recipe is open: one hf jobs command trains the same kind of model on your own labels. The README example (book titles) runs in ~2 minutes for about $0.02.
Demo: huggingface.co/spaces/davans…
Recipe: huggingface.co/datasets/uv-s…
Mukesh Firoda retweeted
Introducing FLUX 3 Action.
An open weights 7B World Action Model that achieves first place on the RoboLab benchmark.
It outperforms the previous best open model by 6.1 percentage points while using 56% fewer parameters and running up to 3.95x faster.
FLUX 3 Action removes the usual trade-off between world action model performance and VLA speed: it still predicts video and actions together, but plans more than twice as far ahead and runs faster per second of robot motion than the strongest open VLA.
Teams can fine-tune FLUX 3 Action on their own demonstrations to create policies for a particular robot and task. Together with @nvidia, we also integrated FLUX 3 Action natively into @huggingface's LeRobot, with fine-tuning recipes included and edge deployment on NVIDIA Jetson.
Beyond robotics, we’re also seeing promising results training task-specific policies for acting in simulated environments like gaming, controlling a vehicle, computer use, and wherever else a model needs to understand a visual environment and then choose what to do next.
FLUX 3 Action builds on the same image, video, and audio pretraining as FLUX 3, but uses a smaller architecture designed for practical deployment. In midtraining, we trained the model to predict actions and future frames together.
We’re releasing the weights, code, fine-tuning recipe, benchmarks, and reproducible examples so researchers and developers can build on the model with their own robots, environments, and tasks (see below).
GitHub rewrote the Copilot agent runtime in Rust.
800,000+ lines.
And they used Copilot to help do it.
AI writing code is becoming less interesting than AI being used to rewrite the infrastructure that runs AI coding tools.
AWS just open-sourced Strands Harness.
Interesting timing.
We’re starting to see more tooling around the part between the model and the real world:
tools, state, context, permissions, execution.
The model might not be the whole agent anymore.
No one is going to read coz everyone likes the hype but not what actually created it
Must-read papers of the week
▪️ JEPA-Anything
▪️ Modality-Autoregressive World-Action Models
▪️ In-Context Robot Learning with VLM Agents
▪️ Dream-RSI: Recursive Self-Improvement through Evolving Worlds
▪️ ModularRSI: Modular and Generalizable Recursive Harness Self-Improvement
▪️ DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression
▪️ SoL-Pi: Recursively Scaling Auto-Research Loops for Efficient Agent Harness
▪️ Confidence Comes from Experience: Experiential Confidence Estimation from Reasoning to Agents
▪️ AliceAI-Foundation-80B-A3B-Base (model release)
▪️ Video DeltaNet: A Video-Native Hybrid Attention for Livestream Video Generation
▪️ ScienceBuddy: Recursive-in-Recursive Self-Improvement for Interactive Scientific Agents
▪️ World Modeling in Transformers
▪️ When2Think: Learning Difficulty-Aware Length Control for Efficient Hybrid Reasoning Models
Explore these to keep up with main AI trends. Here’s also the full list of stunning papers + links and our weekly AI news digest: turingpost.com/p/tracktwo-ai
🚀 @AnthropicAI's Claude Opus 5.5 is now generally available in GitHub Copilot.
Our early testing shows it stands out in efficiency, delivering task resolution comparable to Claude Opus 5 while using significantly fewer steps and tokens, with fast error recovery on multistep tasks.
Try it out for agentic coding, long-running agentic tasks, and knowledge work. Find it in the GitHub Copilot app, CLI, and @code.
github.blog/changelog/2026-0…
Open-source AI is getting cheaper, smaller, and easier to run.
The interesting part isn’t that it’s catching up.
It’s how quickly the gap is closing
It is useful but doesn't look like an interesting topic
Inference scaling part 1.
Starting with a modded text generation function (temperature scaling, top-p filtering, multinomial sampling) to generate diverse outputs for self-consistency and best-of-N (improving answer accuracy by>2x)
00:00 Introduction and recap
00:31 Training-time and inference-time scaling
07:52 What we'll implement
11:47 Notebook setup and model loading
17:43 Building a flexible text generation function
24:40 Chain-of-thought prompting
28:26 Sampling and output diversity
33:43 Next-token logits and greedy decoding
38:20 Temperature scaling step by step
42:46 Softmax and token probabilities
47:42 Multinomial sampling
54:51 Adding temperature sampling to text generation
59:31 Top-p filtering step by step
1:10:23 Adding top-p filtering to text generation
1:13:43 Sampling and LLM watermarking
1:16:01 Self-consistency and majority voting
1:20:36 Implementing self-consistency
1:29:02 MATH-500 results
1:35:01 Accuracy and compute tradeoffs
1:36:50 Next steps and self-refinement
This video is larger than Cloudflare's 512 MB cache, so it can't be played through. More donations are needed to cover a larger cache. Donate