Zikang Xiong (@caffe_tt) header
Zikang Xiong (@caffe_tt) profile picture

Autonomous System

Sunnyvale, CA
Joined December 2016
Photo by Zikang Xiong (@caffe_tt)Photo by Zikang Xiong (@caffe_tt)
Zikang Xiong retweeted
Can we achieve state-of-the-art for mainstream E2E and vectorized driving benchmarks without using any human demonstration data? Terra series at @AppliedInt now tops the NAVSIM, HUGSim, nuPlan val14 and InterPlan benchmarks, powered by self-play RL without imitation, scaling in closed loop with all agents being reactive. 🚘 With TerraZero released a few months ago, we set the SOTA on vectorized benchmarks like nuPlan val14 and InterPlan, powered by our super high-throughput self-play RL framework experiencing 25 centuries of challenging driving scenarios. 📽️ In June this year, TerraTransfer was released as the first of its kind to bring the SOTA vectorized policy from self play (TerraZero) to an E2E policy via image-to-vector encoder alignment, which topped the HUGSim closed-loop score. 🔚 This week, we are thrilled to release TerraTransfer++, a demonstration-free E2E planner setting the SOTA for NAVSIM and HUGSim, by adding planning capability from self-play rollout experience to TerraTransfer. Setting SOTA for public benchmarks is just a beginning, as we have seen the journey from pioneering work like UniAD to successful mass production of E2E ADAS in the industry, but what makes me quite excited is to see the strong signal from a new paradigm with potential to refactorize how the next generation autonomy can be developed, and bring the scalability, safety and performance to the next level. We are the believer of data and scaling, but not just human demonstration data and open-loop scaling like imitation or open-loop RL (AV2.0) - we have the bet on closed-loop scaling with both synthetic and real-world data (AV3.0), and the Terra series is the starting point of the journey towards real product with our bet. Great work from the team @caffe_tt, Weixin Li, Zhouchonghao Wu, @AkshayRangesh, Saarth Bonde, Grantland Hall, @ChenTangMark, Yihan Hu, for creating TerraTransfer and TerraTransfer++! TerraTransfer++ report:  arxiv.org/abs/2610.30319 TerraTransfer++ website: terra-applied.github.io/Terr… TerraTransfer report: arxiv.org/abs/2606.17386
2
17
1
70
4,104
46
1,449
100
17,906
(1/8) Our work titled "Model-free Neural Lyapunov Control for Safe Robot Navigation" was accepted at #IROS2022. Arxiv link: arxiv.org/abs/2203.01190 Demo link: sites.google.com/view/mf-nlc
2
1
1
5
(7/8) We co-learn the neural Lyapunov function and control policy into a reinforcement learning loop. The neural Lyapunov function can adapt to the control policy, while it also acts as a critic and provides an additional training signal for the actor (control policy).
1
(8/8) Finally, the generated Lyapunov function is further used to build a region of attraction providing explicit safety enhancement instead of explicit enhancement provided by reward shaping or constrained optimization.
Zikang Xiong retweeted
C-BRIC researchers and partners can join Zikang Xiong for a talk on "HiSaRL: A Hierarchical Framework for Safe Reinforcement Learning" Thurs., Feb. 10 at 11:00am ET/8:00am PT.
Authors adjusting LaTeX itemize spacing.
You’re unable to view this Post because this account owner limits who can view their Posts. Learn more
17
260
15
1,485