Tianyu Li EasyPaperSniper (@SniperPaper) profile picture

Founding Scientist @ Dexmate | exRS@FAIR | GaTech PhD

Joined September 2019
Photo by Tianyu Li EasyPaperSniper (@SniperPaper)Photo by Tianyu Li EasyPaperSniper (@SniperPaper)Photo by Tianyu Li EasyPaperSniper (@SniperPaper)Photo by Tianyu Li EasyPaperSniper (@SniperPaper)Photo by Tianyu Li EasyPaperSniper (@SniperPaper)Photo by Tianyu Li EasyPaperSniper (@SniperPaper)Photo by Tianyu Li EasyPaperSniper (@SniperPaper)Photo by Tianyu Li EasyPaperSniper (@SniperPaper)Photo by Tianyu Li EasyPaperSniper (@SniperPaper)Photo by Tianyu Li EasyPaperSniper (@SniperPaper)
Tianyu Li EasyPaperSniper retweeted
🤖 Frontier models have taken over the semantic layer of robotics. Almost most hard problems left sit below it. @corl_conf 🔗 agentic-robotics-workshop.gi… 📺 youtu.be/020my0YnzIc 🔥 Hot takes from the CoRL 2026 Workshop on Agentic Robotics, which I was honored to co-organize and host, with @HaoruXue, @Ken_Goldberg, @GuanyaShi, @letian_fu, @YifeiRobotics, @TonyWentaoYuan, @_wenlixiao, @tianyurobot, @SniperPaper, @ChenSiyich, @philippswu, @xdofai, @UnitreeRobotics, @wuji_global, @theWaddleLabs, @DexmateAI. 6 invited talks, 2 Best Demos, 39 papers. 1️⃣ The stack splits by frequency, and safety sits below it. GDM: ~1 Hz orchestrator, 5–50 Hz VLA, 100 Hz whole-body control. Frontier agent loops ran at 0.08–0.18 Hz, and one asked to retract 48 s after high force. 2️⃣ What crosses the seam decides execution. CAD goals beat language by up to 18.6 pp; CameraVLM (9B) went 55.2 → 82.5 with explicit camera + flow tokens (plus ~1.2M QA; no ablation yet). Words aren’t a spatial interface. 3️⃣ Memory is structured state, not longer context. Dexmate’s recall test: text 39%, generated descriptions 60%, frames 70%, frames + scene graph 75%. 4️⃣ “Am I done?” is the hidden bottleneck. 84 of 102 VLM failures in VoLo were completion-monitor errors; the best done-detector scored 86%. 5️⃣ Frontier models are strong policies and slow ones. GPT-6 Astra hit 74.8% on RoboLab-120 vs. 28.0% for π0.5, thinking 95–98% of the time. Driven by coding agents, Dexmate’s robot moved only 20–36% of the time; more tools added cost, not success. 6️⃣ Self-improvement is physical now, and capped by evaluation. Seven loops (ENPIRE, SimEX, GaP, Argon, ATLAS, CaP-RL, Dexmate). ENPIRE’s 99% pass@8 allows up to 8 retries per subtask. No reliable reward, verifier and reset, no loop. 7️⃣ Simulation is agent-written now; calibration is the product. GDM’s Argon turned one photo into a calibrated twin and 4,500+ episodes (real 56% → 75%). Dexmate’s agents assumed friction and mass: 46.6 min of sim, 25% success. 8️⃣ Everything becomes a tool, including the VLA. VoLo tripled real-robot success with π0.5 as an interruptible tool. Best Demo ATLAS skipped VLAs: one human video, a frozen tracker, a residual learned at test time. 9️⃣ Nobody has proven 95% reliability yet. 25/25 has a 95% lower bound of ~86%; ≥95% takes 59 straight successes. On EFE’s 456 core tasks, filtered to be hard, the best agent scores ~34%. 🔟 The bottleneck is commercial: reliability plus cycle time. A self-improving SO-101 still needs 17.4 s per pick vs. a ~7 s/item line. Report k/n, intervals, pass@1, cycle time, $ per success and interventions. Debate of the day: @GuanyaShi said “Goosebumps: a paradigm shift is occurring.” @philippswu said “There will not be a ChatGPT moment for robotics.” Both are right. The research workflow has had its ChatGPT moment; deployment is a slow revolution. #Robotics #EmbodiedAI #CoRL2026 #AgenticRobotics 1️⃣/6️⃣ Ran Zhang (@TencentHunyuan Video AI Center): Ask VLMs whether the camera moved left or right 👉🏻 nitter.cf/junfanzhu98/status/212… 2️⃣/6️⃣ @GuanyaShi (@CMU_Robotics): @karpathy's autoresearch hillclimbs nanochat overnight. What it takes to do the same on real robots? Model isn't the bottleneck. The sandbox is. 👉🏻 nitter.cf/junfanzhu98/status/212… 3️⃣/6️⃣ @Ken_Goldberg (@UCBerkeley): Robotics has a revenue problem, and the blocker is reliability plus cycle time. 👉🏻 nitter.cf/junfanzhu98/status/212… 4️⃣/6️⃣ @philippswu(@xdofai): "There will not be a ChatGPT moment for robotics. It will be a slow revolution." @TonyWentaoYuan (@GoogleDeepMind): System already running on a car production line, and a model that helps build the next model. 👉🏻 nitter.cf/junfanzhu98/status/212… 5️⃣/6️⃣ Jonathan Tremblay (@nvidia): What's left for robotics researchers, after CoRL? 👉🏻 nitter.cf/junfanzhu98/status/212… 6️⃣/6️⃣ @SniperPaper (@DexmateAI): When a coding agent drives a real robot, the robot is moving only 20–36% of the time. 👉🏻 nitter.cf/junfanzhu98/status/212…
2
7
1
27
2,806
Tianyu Li EasyPaperSniper retweeted
Very excited to see recent MBRL/world-model progress. Reported training times went from 72 min for SuperMimic (H100) to 7 min for InstantTrack v1.2 (5090) to 3.4 min for BlinkMimic (4090)! Congrats on those great works! This repo looks at which “implementation factors” help these methods train better. We started it to share implementation tricks, so when people (or coding agents) try to use these models, they can save time and effort. We're adding tasks and baselines, and testing engineering tricks. github.com/Frank-ZY-Dou/ndm-… #Simulation #Robotics #MBRL #BPTT #Humanoid #Graphics
6
22
4
143
19,373
Tianyu Li EasyPaperSniper retweeted
We’re sharing a solution to the Navier-Stokes Millennium Prize Problem, one of the deepest problems at the frontier of mathematics. The proof was produced by a group of agents, using an OpenAI next-generation model significantly more capable than GPT-6 Astra. The problem concerns whether the description of smooth three-dimensional fluid motion modeled by the Navier-Stokes equations can break down. It has remained unresolved for roughly 90 years.
5,636
19,966
14,812
119,629
75,474,734
Tianyu Li EasyPaperSniper retweeted
Claude now connects to the tools creative professionals already use. With the new Blender connector, you can debug a scene, build new tools, or batch-apply changes across every object, directly from Claude.
1,518
4,144
2,524
45,409
12,939,459
Tianyu Li EasyPaperSniper retweeted
We present EgoReAct: Real-time 3D human reaction generation from streaming egocentric video. 🌟Reacting to streaming egocentric video is something humans do every day. We hope EgoReAct makes human motion more human-like. 🔎 What we found: existing ego-reaction data can be spatially inconsistent (e.g., moving reactions paired with fixed-camera videos), which breaks 3D grounding. 📷 What we built: HRD, a spatially aligned egocentric video–reaction dataset (3,500 pairs, 32 categories), plus a spatially aligned ViMo fix for fair evaluation. (Instead of collecting expensive ground-truth motion, we employ VDM to generate the egocentric videos.) 👁️⚡🏃 Our simple yet effective pipeline: motion tokenization for compact discrete codes + an autoregressive Transformer for online, strictly-causal generation. Metric depth and head dynamics further improve 3D spatial consistency. Project Page: frank-zy-dou.github.io/proje… ArXiv: arxiv.org/abs/2512.22808 #HumanMotion #EgocentricVision #3D #ARVR #Animation #AIGC #DeepLearning #GenerativeAI #Graphics #ComputerVision #Motion – at Cambridge, MA
6
28
155
11,445
Tianyu Li EasyPaperSniper retweeted
MoCapAnything Unified 3D Motion Capture for Arbitrary Skeletons from Monocular Videos
6
110
5
800
37,218
Tianyu Li EasyPaperSniper retweeted
Imagine moving a heavy object with a joystick—through a swarm of quadruped-arm robots. 🕹️ decPLM: decentralized RL for multi-robot pinch-lift-move. • No comms or rigid links • Hierarchical RL + constellation reward • 2→ N robots, sim→real 🔗 decplm.github.io/
14
114
9
617
60,278
Wrapping up @GeorgiaTech’s technical tours today, hosting visitors from @icra, with a sword wielding spot demo from @sehoonha and @SniperPaper. @gtcomputing
2
5
759
Tianyu Li EasyPaperSniper retweeted
This is the mobile manipulation I want to see. You can only get this via RL.
3
30
1
308
17,906
Tianyu Li EasyPaperSniper retweeted
Unitree B2-W Talent Awakening! 🥳 One year after mass production kicked off, Unitree’s B2-W Industrial Wheel has been upgraded with more exciting capabilities. Please always use robots safely and friendly. #Unitree #Quadruped #Robotdog #Parkour #EmbodiedAI #IndustrialRobot #InspectionRobot #IntelligentRobot #FoundationModels #LeggedRobot #WheeledLegs
825
3,269
1,521
16,179
14,334,697
Tianyu Li EasyPaperSniper retweeted
It is just so sad that the #NeurIPS2024 main conference ended with such a racist remark by a faculty when talking about ethics. How ironic! I also want to commend the Chinese student who spoke up right on spot. She was respectful, decent, and courageous. Her response was exemplary: she began by acknowledging the speaker’s efforts, then gave the speaker an opportunity to clarify (though, regrettably, the speaker’s reply only reinforced her bias), and ultimately called attention to the inappropriate racial bias and offered constructive suggestions. Thank you for speaking out!
61
258
71
2,068
374,966
Our computer graphics faculty had some amazing research on display at @SIGGRAPHAsia in December, including @sehoonha's work on teaching human movement to quadrupedal robots. youtu.be/zgiUY86MEEI?si=1qQb… via @YouTube
1
1
1
7
2,040
Tianyu Li EasyPaperSniper retweeted
Can human motion be transferred to robots? We present our recent #ICLR paper, CrossLoco, a novel guided unsupervised reinforcement learning algorithm to establish motion correspondence between humans and quadrupeds. @SniperPaper @HyunyoungJung5 @MatthewGombolay #ICLR2024
4
34
160
10,096
Tianyu Li EasyPaperSniper retweeted
Can GPTs generate infinite and diverse data for robotics? Introducing RoboGen, a generative robotic agent that keeps proposing new tasks, creating corresponding environments and acquiring novel skills autonomously! code: github.com/Genesis-Embodied-… 👇🧵 (better with audio)
11
78
15
307
124,489
Tianyu Li EasyPaperSniper retweeted
Announcing Habitat 3.0, simulating humanoid avatars and robots collaborating! - Humanoid sim: diverse skinned avatars - Human-in-the-loop control: mouse/keyboard or VR - Tasks: social navigation and rearrangement Over 1,000 steps per second on 1 GPU for large-scale learning!
8
85
15
476
261,577
Tianyu Li EasyPaperSniper retweeted
Didn't think this is possible but we made it! Glad to finish my master with this exciting project with amazing collaborators @teenhaci, @anag004 and @deepakpathak!
Even after 4yrs of locomotion research, we keep getting surprised by how far we can push the limits of legged robots! We report a major update 🚀🤖 Extreme Parkour: extremely long & high jumps, ramp, handstand, etc. all with a single neural net! extreme-parkour.github.io/ 🧵(1/n)
7
6
1
91
19,534
Tianyu Li EasyPaperSniper retweeted
Can we transfer human motions to characters with very different morphologies? I am happy to share our recent #SIGGRAPHAsia paper, Adversarial Correspondence Embedding (ACE), to retarget human motions onto various characters and robots. @SIGGRAPHAsia @SniperPaper @jeonghwankim0
5
23
1
172
13,880
Tianyu Li EasyPaperSniper retweeted
I'm very excited to share our super simple system for teaching robots complex tasks using existing controllers ◡̈ Building on our prior work, we've taught the A1 challenging skills like bipedal walking. We hope this general recipe simplifies training for all kinds of robots!
We've taught our robot dog new tricks! Our new transfer learning method, TWiRL, makes it possible to train highly agile tasks like jumping and walking on hind legs, and facilitates transfer across tasks and environments: sites.google.com/berkeley.ed…
12
44
4
360
78,255
Tianyu Li EasyPaperSniper retweeted
Our work, "Learning and Adapting Agile Locomotion Skills by Transferring Experience" (sites.google.com/berkeley.ed…) will be presented today at @RoboticsSciSys in Session 7. Mobile Manipulation and Locomotion. Congratulations again, @smithlaura1028 @svlevine @xbpeng4 @SniperPaper
5
31
5,481
Tianyu Li EasyPaperSniper retweeted
In addition to hardware such as DIGIT, developing touch sensing as a modality requires an ecosystem of touch processors, simulators, benchmarks & data sets. Read more about our ongoing work in developing & open-sourcing this ecosystem: ai.facebook.com/blog/teachin…
1
18
4
92