Skip to yearly menu bar Skip to main content


Oral
in
Workshop: 7th Robot Learning Workshop: Towards Robots with Human-Level Abilities

AirExo-2: Scaling up Generalizable Robotic Imitation Learning with Low-Cost Exoskeletons

Hongjie Fang · Chenxi Wang · Yiming Wang · Jingjing Chen · Shangning Xia · Jun Lv · Zihao He · Xiyan Yi · Yunhan Guo · Xinyu Zhan · Lixin Yang · Weiming Wang · Cewu Lu · Hao-Shu Fang

[ ] [ Project Page ]
 
presentation: 7th Robot Learning Workshop: Towards Robots with Human-Level Abilities
Sat 26 Apr 5:55 p.m. PDT — 3 a.m. PDT

Abstract:

Scaling up imitation learning for real-world applications requires efficient and cost-effective demonstration collection methods. Current teleoperation approaches, though effective, are expensive and inefficient due to the dependency on physical robot platforms. Alternative data sources like in-the-wild demonstrations can eliminate the need for physical robots and offer more scalable solutions. However, existing in-the-wild data collection devices have limitations: handheld devices offer restricted in-hand camera observation, while whole-body devices often require fine-tuning with robot data due to action inaccuracies. In this paper, we propose AirExo-2, a low-cost exoskeleton system for large-scale in-the-wild demonstration collection. By introducing the demonstration adaptor to transform the collected in-the-wild demonstrations into pseudo-robot demonstrations, our system addresses key challenges in utilizing in-the-wild demonstrations for downstream imitation learning in real-world environments. Additionally, we present RISE-2, a generalizable policy that integrates 2D and 3D perceptions, outperforming previous imitation learning policies in both in-domain and out-of-domain tasks, even with limited demonstrations. By leveraging in-the-wild demonstrations collected and transformed by the AirExo-2 system, without the need for additional robot demonstrations, RISE-2 achieves comparable or superior performance to policies trained with teleoperated data, highlighting the potential of AirExo-2 for scalable and generalizable imitation learning.

Chat is not available.