動作データからの再構成可能ロボットの自己同定
Reconfigurable Robot Identification from Motion Data
固有感覚(関節の位置や動きの内部感覚)だけから、12自由度の再構成可能な脚ロボットの形態(どのような構成か)を深層ニューラルネットで推定するメタ自己モデリング手法を提案した論文。
著者: Yuhang Hu, Yunzhe Wang, Ruibo Liu, Zhou Shen, Hod Lipson
分類: cs.RO
原文アブストラクト
Integrating Large Language Models (VLMs) and Vision-Language Models (VLMs) with robotic systems enables robots to process and understand complex natural language instructions and visual information. However, a fundamental challenge remains: for robots to fully capitalize on these advancements, they must have a deep understanding of their physical embodiment. The gap between AI models cognitive capabilities and the understanding of physical embodiment leads to the following question: Can a robot autonomously understand and adapt to its physical form and functionalities through interaction with its environment? This question underscores the transition towards developing self-modeling robots without reliance on external sensory or pre-programmed knowledge about their structure. Here, we propose a meta self modeling that can deduce robot morphology through proprioception (the internal sense of position and movement). Our study introduces a 12 DoF reconfigurable legged robot, accompanied by a diverse dataset of 200k unique configurations, to systematically investigate the relationship between robotic motion and robot morphology. Utilizing a deep neural network model comprising a robot signature encoder and a configuration decoder, we demonstrate the capability of our system to accurately predict robot configurations from proprioceptive signals. This research contributes to the field of robotic self-modeling, aiming to enhance understanding of their physical embodiment and adaptability in real world scenarios.
関連論文
- 堅牢な視覚的具現化:実環境でロボットが自己の身体を発見する方法自己モデリング
- ロボットが自己のシミュレーションを構築する学習自己モデリング
- 高自由度動的ニューラルフィールドによるロボット自己モデリングと動作計画自己モデリング
- 自己モデリングの起源について自己モデリング
- 自己視点の視覚によるロボットの自己ダイナミクスモデリングと適応自己モデリング
- ロボット形態の全身視覚的自己モデリング自己モデリング
