ロボット形態の全身視覚的自己モデリング
Full-Body Visual Self-Modeling of Robot Morphologies
ロボットが自身の形状を空間占有クエリで学習する視覚的自己モデルを提案し、運動計画や損傷検出・復帰を実現した。
著者: Boyuan Chen, Robert Kwiatkowski, Carl Vondrick, Hod Lipson
分類: cs.RO, cs.AI, cs.CV, cs.LG, cs.SY, eess.SY
原文アブストラクト
Internal computational models of physical bodies are fundamental to the ability of robots and animals alike to plan and control their actions. These "self-models" allow robots to consider outcomes of multiple possible future actions, without trying them out in physical reality. Recent progress in fully data-driven self-modeling has enabled machines to learn their own forward kinematics directly from task-agnostic interaction data. However, forward-kinema\-tics models can only predict limited aspects of the morphology, such as the position of end effectors or velocity of joints and masses. A key challenge is to model the entire morphology and kinematics, without prior knowledge of what aspects of the morphology will be relevant to future tasks. Here, we propose that instead of directly modeling forward-kinematics, a more useful form of self-modeling is one that could answer space occupancy queries, conditioned on the robot's state. Such query-driven self models are continuous in the spatial domain, memory efficient, fully differentiable and kinematic aware. In physical experiments, we demonstrate how a visual self-model is accurate to about one percent of the workspace, enabling the robot to perform various motion planning and control tasks. Visual self-modeling can also allow the robot to detect, localize and recover from real-world damage, leading to improved machine resiliency. Our project website is at: https://robot-morphology.cs.columbia.edu/
関連論文
- 堅牢な視覚的具現化:実環境でロボットが自己の身体を発見する方法自己モデリング
- 動作データからの再構成可能ロボットの自己同定自己モデリング
- ロボットが自己のシミュレーションを構築する学習自己モデリング
- 高自由度動的ニューラルフィールドによるロボット自己モデリングと動作計画自己モデリング
- 自己モデリングの起源について自己モデリング
- 自己視点の視覚によるロボットの自己ダイナミクスモデリングと適応自己モデリング
