ロボットが自己のシミュレーションを構築する学習
Teaching Robots to Build Simulations of Themselves
短い動画データのみから自己教師あり学習でロボットが自身の形態・運動学・制御をモデル化し、動作予測や異常検知、損傷からの復帰を可能にするフレームワークを提案。
著者: Yuhang Hu, Jiong Lin, Hod Lipson
分類: cs.RO, cs.AI, cs.CV
原文アブストラクト
The emergence of vision catalysed a pivotal evolutionary advancement, enabling organisms not only to perceive but also to interact intelligently with their environment. This transformation is mirrored by the evolution of robotic systems, where the ability to leverage vision to simulate and predict their own dynamics marks a leap towards autonomy and self-awareness. Humans utilize vision to record experiences and internally simulate potential actions. For example, we can imagine that, if we stand up and raise our arms, the body will form a T shape without physical movement. Similarly, simulation allows robots to plan and predict the outcomes of potential actions without execution. Here we introduce a self-supervised learning framework to enable robots to model and predict their morphology, kinematics and motor control using only brief raw video data, eliminating the need for extensive real-world data collection and kinematic priors. By observing their own movements, akin to humans watching their reflection in a mirror, robots learn an ability to simulate themselves and predict their spatial motion for various tasks. Our results demonstrate that this self-learned simulation not only enables accurate motion planning but also allows the robot to detect abnormalities and recover from damage.
関連論文
- 堅牢な視覚的具現化:実環境でロボットが自己の身体を発見する方法自己モデリング
- 動作データからの再構成可能ロボットの自己同定自己モデリング
- 高自由度動的ニューラルフィールドによるロボット自己モデリングと動作計画自己モデリング
- 自己モデリングの起源について自己モデリング
- 自己視点の視覚によるロボットの自己ダイナミクスモデリングと適応自己モデリング
- ロボット形態の全身視覚的自己モデリング自己モデリング
