
PhD student @Cornell working on leveraging foundation models for robot manipulation.
Joined April 2022
- Tweets29
- Following112
- Followers185
- Likes362
Chuanruo Ning retweeted
1/7 Excited to share SceneRig! 🦾
One image → an editable, simulation-ready 3D scene.
We combine AI agents with geometry and physics to reconstruct scenes for robot policy evaluation and replay of real-world manipulations.
Here’s how it works 🧵👇
Humanoids can learn new skills by tracking high-quality reference motions, which today come from humans through motion capture or video. Routing every reference through a human proxy limits scalability and compounds reconstruction errors with the embodiment gap. KinoGen synthesizes loco-manipulation references directly for the target robot through kinematically grounded video generation. 🧵 (1/7)
Chuanruo Ning retweeted
Ever suffered from making slides like I do? 😭
Aligning everything, fighting animations, trying to add cool interactive visualizations…while AI generated slides still look extremely confusing and overwhelming.
So I vibecoded JostSlides
⭐ github.com/guangzhaohe/JostS…
🧵 (1/n)
How can generalist policies learn new skills without losing their pretrained prior?
We introduce Proxy Policy Steering (PPS), which uses proxy policies to steer the frozen base policy at inference, adding task-specific behavior without touching its weights.
Thank the authors of DSRL @ajwagenmaker, DynaGuide and Proxy Tuning @alisawuffles for the inspiration!
Because the proxies are separate networks, PPS can route new modalities, such as point clouds or audio, into the frozen base, enabling capabilities only possible with new sensors.
Please check out our website/paper/code!
🌐 Website: ppsteering.github.io
📝 Paper: arxiv.org/abs/2609.09148
💻 Code: github.com/TritiumR/pps
Thanks to my collaborator @TerryWang300, and to my supervisors @weichiuma and @kuanfang!
See you in Austin! #CoRL
And planning alone is not enough for robotics. Many low-level skills are difficult or impractical to specify in natural language or code. Think about riding a bike: describing what to do is very different from learning the continuous feedback and control.
Chuanruo Ning retweeted
1/ Finally get to share what I’ve been working on this summer at @datologyai. We built DataSmith 🍊, an automated data researcher.
The idea is simple: scale test-time compute across multiple directions, then let agents synthesize their findings.
Blog: datologyai.com/blog/datasmit…
Chuanruo Ning retweeted
Introducing Unified Motion-Action (UMA) Model, a robot foundation model that uses 3D object motion as a shared interface for heterogeneous robot learning. UMA treats motion and action as co-evolving variables, enabling knowledge transfer across data sources and versatile inference. 🧵 1/n
Chuanruo Ning retweeted
Introducing KITE 🪁, a paradigm that transfers the interaction intent instead of joint-space actions across structurally different manipulators. Deploying on a new robot needs only its kinematics model (URDF), no new task demonstrations. 🧵1/8
Chuanruo Ning retweeted
Teleoperation is slow, expensive, and difficult to scale. So how can we train our robots instead?
Introducing X-Sim: a real-to-sim-to-real framework that trains image-based policies 1) learned entirely in simulation 2) using rewards from human videos.
portal-cornell.github.io/X-S…
How can robots solve tasks that demand both semantic and physical reasoning, like playing real-world Angry Birds, without tons of data?
We introduce Prompting with the Future: an MPC framework that fuses a pretrained VLM with an interactive digital twin for grounded, open-world motion planning.
🌐 prompting-with-the-future.gi…
By explicitly modeling dynamics with an interactive digital twin, our method significantly outperforms baselines that directly prompt or fine-tune the VLM to handle both semantics and physics.
Check out our paper and project page for more information.
Prompting with the Future: Open-World Model Predictive Control with Interactive Digital Twins
📄 arxiv.org/abs/2506.13761
🌐 prompting-with-the-future.gi…
💻 github.com/TritiumR/Promptin…
Huge thanks to my advisors: @KuanFang and @weichiuma








