潜在拡散モデルによる物理的に整合したヒューマノイドの移動操作
Physically Consistent Humanoid Loco-Manipulation using Latent Diffusion Models
潜在拡散モデルで生成した人間と物体のインタラクション画像から接触位置とロボット姿勢を抽出し、全身軌道最適化に用いることで、物理的に整合したヒューマノイドの長期的な移動操作軌道を生成する手法を提案した。
著者: Ilyass Taouil, Haizhou Zhao, Angela Dai, Majid Khadiv
分類: cs.RO, cs.GR
原文アブストラクト
This paper uses the capabilities of latent diffusion models (LDMs) to generate realistic RGB human-object interaction scenes to guide humanoid loco-manipulation planning. To do so, we extract from the generated images both the contact locations and robot configurations that are then used inside a whole-body trajectory optimization (TO) formulation to generate physically consistent trajectories for humanoids. We validate our full pipeline in simulation for different long-horizon loco-manipulation scenarios and perform an extensive analysis of the proposed contact and robot configuration extraction pipeline. Our results show that using the information extracted from LDMs, we can generate physically consistent trajectories that require long-horizon reasoning.
