Open-TeleVision: 没入型アクティブ視覚フィードバックによる遠隔操作
Open-TeleVision: Teleoperation with Immersive Active Visual Feedback
操作者がロボットの周囲を立体的に知覚し、腕と手の動きがロボットに反映される没入型遠隔操作システムを提案し、2種類のヒューマノイドで模倣学習データを収集して実世界で検証した。
著者: Xuxin Cheng, Jialong Li, Shiqi Yang, Ge Yang, Xiaolong Wang
分類: cs.RO, cs.HC, cs.LG
原文アブストラクト
Teleoperation serves as a powerful method for collecting on-robot data essential for robot learning from demonstrations. The intuitiveness and ease of use of the teleoperation system are crucial for ensuring high-quality, diverse, and scalable data. To achieve this, we propose an immersive teleoperation system Open-TeleVision that allows operators to actively perceive the robot's surroundings in a stereoscopic manner. Additionally, the system mirrors the operator's arm and hand movements on the robot, creating an immersive experience as if the operator's mind is transmitted to a robot embodiment. We validate the effectiveness of our system by collecting data and training imitation learning policies on four long-horizon, precise tasks (Can Sorting, Can Insertion, Folding, and Unloading) for 2 different humanoid robots and deploy them in the real world. The system is open-sourced at: https://robot-tv.github.io/
