
Computer vision by day, open source by night 🦇 | building @rimward_ai @pyro_near | prev @ycombinator (YC S23) @CentraleSupelec
Paris, FR
Joined October 2013
- Tweets1.2K
- Following570
- Followers555
- Likes4.3K
Pinned Tweet
Last Friday, we were invited to join the roundtable discussion with @sama, CEO @OpenAI & former president of YC.
A humbling experience & fitting coincidence, since @quack_ai has been selected to join the prestigious batch of @ycombinator 🚀
Credits: Romain Ruiz 📸
F-G Fernandez retweeted
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math.
It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training.
We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵
Blog: rikiyat.github.io/blog/weigh…
Readers added context they thought people might want to know
LLM was given weights explicitly as text in prompt and used code/forward passes (per authors' logs) to ablate Qwen looping direction, a known thinking-mode issue per model card. Primarily fixed repetition in that mode, not general 'natively' improving weights/math.
rikiyat.github.io/blog/weight-sp…
github.com/RikiyaT/lm_und…
huggingface.co/Qwen/Qwen3.5-0…
huggingface.co/RikiyaT/Qwen3.…
F-G Fernandez retweeted
Exciting day for NVIDIA and @huggingface.
Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty. They allow every developer, startup, university, industry and country to build with, customize and benefit from AI.
Thank you @ClementDelangue for coming to me.
NVIDIA is going to be a great home for Hugging Face, its community and the future of open models. 🤗
blogs.nvidia.com/blog/nvidia…
F-G Fernandez retweeted
Super happy to share our intention to join forces with NVIDIA in a $12,930,300,000 acquisition 💛💚
10 years after starting Hugging Face, open-source AI is at an inflection point. Thanks to the community, we’ve shown that it can be a complement, and even an alternative, to closed-source APIs. But for it to happen at larger scale, it needs more compute, more support, more collaboration and more visibility. That’s why we went to talk to Jensen, who offered to do exactly that with us.
In addition to doubling down on NVIDIA’s massive contributions to open-source AI (I called them the “King of American open-source AI” earlier this year), they’ve committed to strongly supporting Hugging Face and our mission while keeping the platform open, independent and compute agnostic. The founders and the team are all staying to keep pushing this mission forward.
Together, we think we can make open source the default way to build AI, with the goal of empowering 100 million AI builders to own their intelligence rather than rent it.
Excited about the next 10 years! 🤗🤗🤗
F-G Fernandez retweeted
i open-sourced autokernel -- autoresearch for GPU kernels
you give it any pytorch model. it profiles the model, finds the bottleneck kernels, writes triton replacements, and runs experiments overnight. edit one file, benchmark, keep or revert, repeat forever.
same loop as @karpathy autoresearch, applied to kernel optimization
95 experiments. 18 TFLOPS → 187 TFLOPS. 1.31x vs cuBLAS. all autonomous
9 kernel types (matmul, flash attention, fused mlp, layernorm, rmsnorm, softmax, rope, cross entropy, reduce). amdahl's law decides what to optimize next. 5-stage correctness checks before any speedup counts
the agent reads program.md (the "research org code"), edits kernel.py, runs bench.py, and either keeps or reverts. ~40 experiments/hour. ~320 overnight
ships with self-contained GPT-2, LLaMA, and BERT definitions so you don't need the transformers library to get started
github.com/RightNow-AI/autok…
The FA4 paper is finally out after a year of work. On Blackwell GPUs, attention now goes about as fast as matmul even though the bottlenecks are so different! Tensor cores are now crazy fast that attn fwd is bottlenecked by exponential, and attn bwd is bottlenecked by shared memory bandwidth.
Some fun stuff in the redesigned algorithm to overcome these bottlenecks: exponential emulation with polynomials, new online softmax to avoid 90% of softmax rescaling, 2CTA MMA instructions that allow two thread blocks to share operands to reduce smem traffic.
Asymmetric hardware scaling is here. Blackwell tensor cores are now so fast, exp2 and shared memory are the wall. FlashAttention-4 changes the algorithm & pipeline so that softmax & SMEM bandwidth no longer dictate speed. Attn reaches ~1600 TFLOPs, pretty much at matmul speed!
joint work w/ Markus Hoehnerbach, Jay Shah(@ultraproduct), Timmy Liu, Vijay Thakkar (@__tensorcore__ ), Tri Dao (@tri_dao)
1/
F-G Fernandez retweeted
Step inside Project Genie: our experimental research prototype that lets you create, edit, and explore virtual worlds. 🌎
F-G Fernandez retweeted
We’re back in a Flash ⚡
Gemini 3 Flash is our latest model with frontier intelligence built for lightning speed, and pushing the Pareto Frontier of performance and efficiency. It outperforms 2.5 Pro while being 3x faster at a fraction of the cost.
With this release, Gemini 3’s next-generation intelligence is now rolling out to everyone across our products including @Geminiapp + AI Mode in Search. Devs can build with it in the Gemini API @GoogleAIStudio, Gemini CLI, and Google @antigravity and enterprises can get it in Vertex AI and Gemini Enterprise.
F-G Fernandez retweeted
Announcing the Beta release of ty: an extremely fast type checker and language server for Python, written in Rust.
We now use ty exclusively in our own projects and are ready to recommend it to motivated users.
10x, 50x, even 100x faster than existing type checkers and LSPs.
F-G Fernandez retweeted
we broke software into “design” and “engineering” and trapped ourselves in frames and specs.
Cursor’s new visual editor lets you play with ideas and designs in code, live.
no more hand-offs, just click, chat, tweak the tiniest detail, in the actual thing you will ship.
F-G Fernandez retweeted
Introducing the Devstral 2 coding model family. Two sizes, both open source.
Also, meet Mistral Vibe, a native CLI, enabling end-to-end automation.
🧵
F-G Fernandez retweeted
🚀 Launching DeepSeek-V3.2 & DeepSeek-V3.2-Speciale — Reasoning-first models built for agents!
🔹 DeepSeek-V3.2: Official successor to V3.2-Exp. Now live on App, Web & API.
🔹 DeepSeek-V3.2-Speciale: Pushing the boundaries of reasoning capabilities. API-only for now.
📄 Tech report: huggingface.co/deepseek-ai/D…
1/n
F-G Fernandez retweeted
Introducing Claude Opus 4.5: the best model in the world for coding, agents, and computer use.
Opus 4.5 is a step forward in what AI systems can do, and a preview of larger changes to how work gets done.
F-G Fernandez retweeted
Today, our team launched Google Antigravity.
- Agent-first IDE powered by Gemini 3 Pro 🧠
- Browser control to test your apps automatically 🤖
- Agent Manager to orchestrate parallel agents ♾️
Stoked to keep shipping with the @antigravity team. This is going to be fun.
F-G Fernandez retweeted
Introducing Gemini 3 Pro, the world's most intelligent model that can help you being anything to life.
It is state of the art across most benchmarks, but really comes to life across our products (AI Studio, the Gemini API, Gemini App, etc) 🤯
F-G Fernandez retweeted
After a year of team work, we're thrilled to introduce Depth Anything 3 (DA3)! 🚀
Aiming for human-like spatial perception, DA3 extends monocular depth estimation to any-view scenarios, including single images, multi-view images, and video.
In pursuit of minimal modeling, DA3 reveals two key insights:
💎 A plain transformer (e.g., vanilla DINO) is enough. No specialized architecture.
✨ A single depth-ray representation is enough. No complex 3D tasks.
Three series of models have been released: the main DA3 series, a monocular metric estimation series, and a monocular depth estimation series.
The core team members, aside from me: @HaotongLin, Sili Chen, Jun Hao Liew, @donydchen.
👇(1/n)
#DepthAnything3
F-G Fernandez retweeted
SIMA 2 is our most capable AI agent for virtual 3D worlds. 👾🌐
Powered by Gemini, it goes beyond following basic instructions to think, understand, and take actions in interactive environments – meaning you can talk to it through text, voice, or even images. Here’s how 🧵
F-G Fernandez retweeted
After ~4 years building SOTA models & datasets, we're sharing everything we learned in ⚡The Smol Training Playbook
We cover the full LLM cycle: designing ablations, choosing an architecture, curating data, post-training, and building solid infrastructure.
We'll help you navigate the messy training reality that LLM papers don't cover. Chapter highlights in the 🧵
F-G Fernandez retweeted
Introducing Claude Sonnet 4.5—the best coding model in the world.
It's the strongest model for building complex agents. It's the best model at using computers. And it shows substantial gains on tests of reasoning and math.
F-G Fernandez retweeted
This is Ray3. The world’s first reasoning video model, and the first to generate studio-grade HDR. Now with an all-new Draft Mode for rapid iteration in creative workflows, and state of the art physics and consistency. Available now for free in Dream Machine.
































