
geometry is all you need / @ucberkeleymet
SF
Joined September 2022
- Tweets206
- Following828
- Followers173
- Likes2.2K
Vardhan Shorewala retweeted
As a robot learning model lab, how do you price this in as you go to raise future rounds?
I see two options:
- Pursue hand to hand combat with Anthropic/OAI and hope someone will fund the capex
- Go beast mode on deployments
In the second option you still will compete with the likes of OAI/Ant, but more greenfield (more potential winners)
Replying to @claudeai
Fable 5.2 shows substantially improved skills in controlling physical robots, even on tasks it has never explicitly been trained to do.
On RoboDojo, a benchmark with a simulated two-arm robot, it outperformed other models and most AI systems built to control robots.
generalist policies > specialist
Replying to @claudeai
Fable 5.2 shows substantially improved skills in controlling physical robots, even on tasks it has never explicitly been trained to do.
On RoboDojo, a benchmark with a simulated two-arm robot, it outperformed other models and most AI systems built to control robots.
6
282
Vardhan Shorewala retweeted
We asked GPT-6 Astra to edit Qwen3.5-0.8B weights to improve math.
It directly changed only 0.016% of weights, fixing 0.8B's reasoning loops & improving math up to 6x and even instruction following 3x, without gradients or training.
We call this Weight-Space Programming: frontier LLMs can now natively read/write neural network weights! 🧵
Blog: rikiyat.github.io/blog/weigh…
Readers added context they thought people might want to know
LLM was given weights explicitly as text in prompt and used code/forward passes (per authors' logs) to ablate Qwen looping direction, a known thinking-mode issue per model card. Primarily fixed repetition in that mode, not general 'natively' improving weights/math.
rikiyat.github.io/blog/weight-sp…
github.com/RikiyaT/lm_und…
huggingface.co/Qwen/Qwen3.5-0…
huggingface.co/RikiyaT/Qwen3.…
Vardhan Shorewala retweeted
Tactile is great only if it’s targeted correctly.
Meaning the end effector tactile sensors on robots must be the similar to the capture device
Vardhan Shorewala retweeted
Almost all bimanual robots include wrist cameras. They add bulk, cost, and complexity, but are critical for performance. Are they really needed?
Excited to finally share EyeRobot 2.0, where we use active gaze from an ego stereo camera instead 🧵 (with @kushtimusprime)
Introducing GLM-5.3-Flash
- Leading capabilities at a highly competitive price
- Natively multimodal with a 1M-token context window
- A 320B-A18B model released under the MIT License
- Previously previewed as Ox Alpha, running entirely on Chinese AI chips
Blog: z.ai/blog/glm-5.3-flash
Available now across all official platforms:
Weights: huggingface.co/zai-org/GLM-5…
API: docs.z.ai/guides/llm/glm-5.3…
Coding Plan: z.ai/subscribe
ZCode: zcode.z.ai/en
Chat: chat.z.ai
AutoClaw: autoclaw.z.ai
crowdsourcing data will never scale.
will get shilled low-quality datasets and get hit with regional privacy laws.
1
244
Text has always been a zero-sum game.
Language is such a waste of my params
ok, so if i understood this correctly, the “in-context learning” ability was essentially baked into the model at training time. roughly speaking, the policy is trained to do something like:
(demo video, current obs) → action
this is quite different from in-context learning in llms, where the model is simply trained on next-token prediction over arbitrary context.
fwiw, this is pretty clever because it could also solve another problem: they could pair an egocentric video-only demonstration with a UMI/teleop trajectory for the same task. the target trajectory provides the action labels, while the video-only demonstration provides the task context. that way, the policy can learn from action-labeled robot data while also learning how to translate an unlabeled video demonstration into robot actions.
1
304
Vardhan Shorewala retweeted
Today we are introducing Dyna-2, a world-action model pre-trained on one million hours of human video. At this scale, for the first time, we discovered several new scaling laws:
• world-action models exhibit scaling law on human data across four orders of magnitude, from 1000 to 1,000,000 hours,
• this human data scaling law implied a scaling law on never seen robot data,
• both data and objective matter; world modeling and scaling on video data are essential for cross-embodiment scaling transfer to emerge
🧵














