
Pinned Tweet
Our new work, STITCH 2.0, can perform consecutive running sutures to close a sample wound with the daVinci robot.
Kush Hari retweeted
Back in ~Dec 2025, I really wanted to work on mobile manipulation, but robots were either too expensive or not performant enough.
So we built our own!
Excited to finally share something I’ve had so much fun working on:
1. Pixel: a co-designed full stack system for learning mobile manipulation.
2. Pixel-UMI: environment aware whole body manipulation without robot data.
w/ @JasonJZLiu
(1/N)
Kush Hari retweeted
Excited to finally share Pixel: a full-stack robot learning project @_tonytao_ and I worked on earlier this year!
We’re releasing two papers:
1. Pixel: A low-cost mobile manipulator, co-designed with its UMI system and learning stack. pixel-robot.com/pixel/
2. Pixel-UMI: Improved UMI pipeline for learning environment-aware, whole-body manipulation
pixel-robot.com/pixel-umi/
(1/N)
Kush Hari retweeted
We always talk about models in robot learning, yet data quality is just as important (if not more!). How do we collect good data?
It turns out RL can help you *during* data collection! If you're collecting demos, ✨Data Inoculation✨ is a simple addition to collect better data!
Kush Hari retweeted
Human videos bring scale and motion priors to robot pretraining. But video mainly captures human states, leaving intended actions implicit. Applied forces help fill that gap. Introducing FACT: learning dexterous manipulation from human video and force. 🧵
Kush Hari retweeted
Check out our #CoRL2026 paper COWBOY 🤠!
We learn mobile manipulation from sim-to-real that generalizes to diverse objects and scenes
Context isn’t just what you put in a prompt. It’s also what stands between a robot and its goal. Robot policies in everyday environments must generalize not only across objects, but also across the spatial contexts in which they appear.
Excited to share COWBOY 🤠 (CoRL 2026) — our sim-to-real recipe for contextual whole-body manipulation. One generalist grasping policy coordinates base, arm, dexterous hand, and active vision end-to-end, adapting its motion and grasps to object and scene geometry. Trained in simulation, deployed zero-shot in the wild.
w/ @JasonJZLiu @LiuMuxinl
🧵(1/N)
Kush Hari retweeted
Last year I trained the advantage-conditioned VLA for π*0.6 during my internship @physical_int. Now, I have a much improved recipe.
Introducing ✨Advantage Guidance✨, a performant RL method with stable advantage-conditioned supervised training and contrastive guidance sampling
Kush Hari retweeted
We gave Claude and GPT a phone video of a robot wiping. In an hour, each built a full-dynamics digital twin.
Introducing RoboSimStudio 🤖: an open and interactive toolkit for Agentic Robotics, enabling Fable, Astra and Argon AI agents to model sponges 🧽, cables 🧵 and cloth 👔.
Kush Hari retweeted
Want to know how well agents can really control robots directly?
In RoboARCade, we systematically evaluate and diagnose frontier agents controlling robots directly using tens of thousands of dollars’ worth of agent trajectories. RoboARCade contains diverse, precise, and long-horizon tasks. Paper, code, assets and every trace are out today. roboarcade.org
Kush Hari retweeted
(1/N) Who says you can't do contact-rich, precise manipulation with sim-to-real RL?
No demonstrations, no retargeting, no tactile sensors, no crazy reward tuning. Just 1x, reactive policies trained with scaled up RL.
Excited to finally release Success-Guided Sampling (SGS)! More info in @octi_zhang's thread and more thoughts of my own below! 🧵
Website here: sgs-rl.github.io
(1/5) Everyone says dexterous manipulation needs real-world data. These policies were trained with none. Our robots mesh gears, thread nuts, and insert pegs zero-shot from RGB, and the same recipe works for locomotion across terrains much harder than before.
The missing piece wasn't a better RL algorithm, but a small tweak to what the robot practices.
Today we're releasing Success-Guided Sampling (SGS), a simple change to the task sampler that unlocks new levels of dexterity and agility with large-scale, end-to-end sim2real RL.
No demonstrations, no per-task reward tuning. Just PPO at scale.
Check out the policies yourself at sgs-rl.github.io! All videos at 1x speed! 🧵 🔈
Kush Hari retweeted
Real2sim has made impressive progress with coding agents. But what about sim2real, especially the visual gap? Meet RoboRender: turning simulated trajectories into photorealistic videos for policy training, achieving 71% average success in zero-shot real-world robot deployment.
Kush Hari retweeted
Very excited to release EyeRobot 2.0! We also built a simulation environment with 6 manipulation tasks and around 1,800 evaluation trials. Demos were collected in VR with the same GELLO-style setup we use on the real robot, and two tasks (pot and tape) mirror our real-world ones. Sim let us iterate much faster and test more ideas at scale, and the same overall trends carried over to the real robot.
Almost all bimanual robots include wrist cameras. They add bulk, cost, and complexity, but are critical for performance. Are they really needed?
Excited to finally share EyeRobot 2.0, where we use active gaze from an ego stereo camera instead 🧵 (with @kushtimusprime)
Kush Hari retweeted
Excited to introduce QF3: Fast Flow RL with Filtered Q-Gradients!
Train humanoids from scratch, fine-tune VLAs, even fine-tune image models... all with one simple off-policy update ✨
Excited to release EyeRobot 2.0! We noticed it is better at dealing with distractors. When the gaze policy looks at the right target, the policy can recover
Almost all bimanual robots include wrist cameras. They add bulk, cost, and complexity, but are critical for performance. Are they really needed?
Excited to finally share EyeRobot 2.0, where we use active gaze from an ego stereo camera instead 🧵 (with @kushtimusprime)
Kush Hari retweeted
Humans generalize from rich interaction experience. We bring this to humanoid loco-manipulation through scalable real-to-sim-to-real.
Introducing PRISM, we expand 4 real videos into 256 counterfactual variants, recover robot-object trajectories, and train one policy that generalizes across diverse objects, scales, and spatial layouts.
CoRL’26 🚀 Website for details 👉 prism-real2sim2real.github.i…
Work done at Amazon FAR w/ @zhenkirito123 @pabbeel @rocky_duan @JitendraMalikCV @carlo_sferrazza @ckarenliu @GuanyaShi @akanazawa
Kush Hari retweeted
Can robots help in data centers? It’s tricky when all the cables are the same color.
Introducing TRACE: bi-directional tracing + interactive perception for monochrome cables, @ #IROS2026 from @AUTOLab_Cal @UCBerkeley (1/8)
Kush Hari retweeted
Happy to announce the full ABC release! We’re also excited that ABC was accepted to CoRL 2026!
Check out our website for code, 400+ hours of sim data on 24 tasks, and 5,850 labeled policy-evaluation episodes.
@arthurallshire @Cinnabar233 @ritvik_singh9 @redstone_hong @davidrmcall
Kush Hari retweeted
Grounded API is live.
- SOTA on hand-tracking benchmarks (< 1 cm)
- SOTA on SLAM benchmarks
- In-the-wild ego data -> enriched data in minutes
- Integration with @huggingface @LeRobotHF & @rerundotio
- Built for @BitRobotNetwork RoboCap suite
Technical report & more↓
Kush Hari retweeted
Our social systems and institutions confuse me all the time. 😕
AI may make them even more complicated. What if it also represents us inside them?
We already delegate representation constantly - your employer negotiates your insurance, your lawyer negotiates your contract, your representatives advocate for your interests.
Wrote up some early thinking on what financial markets can teach us here, what we found in our recent paper Cooperate to Compete (now accepted to EMNLP), and why one of the hardest open problems may be designing the structures agents negotiate inside rather than the agents themselves.
Read my first research blog below!! I would love to hear any thoughts on how folks are thinking about this.
Blog: abbykoneill.github.io/posts/…
Kush Hari retweeted
here’s an uncut, real-time video of our policy stacking and destacking a cup tower
Excited to share SPD: simulation pre-training for dexterity. We pre-trained a policy in simulation and fine-tuned with less than 2 hours of real data (with @sarthakkamat)
Kush Hari retweeted
Excited to share SPD: simulation pre-training for dexterity. We pre-trained a policy in simulation and fine-tuned with less than 2 hours of real data (with @sarthakkamat)



















