物理的に妥当な全身の手と物体のインタラクション合成
Physically Plausible Full-Body Hand-Object Interaction Synthesis
強化学習と物理シミュレーションを用いて、全身の手と物体のインタラクションを物理的に妥当に合成する手法を提案。
著者: Jona Braun, Sammy Christen, Muhammed Kocabas, Emre Aksan, Otmar Hilliges
分類: cs.RO, cs.CV, cs.LG
原文アブストラクト
We propose a physics-based method for synthesizing dexterous hand-object interactions in a full-body setting. While recent advancements have addressed specific facets of human-object interactions, a comprehensive physics-based approach remains a challenge. Existing methods often focus on isolated segments of the interaction process and rely on data-driven techniques that may result in artifacts. In contrast, our proposed method embraces reinforcement learning (RL) and physics simulation to mitigate the limitations of data-driven approaches. Through a hierarchical framework, we first learn skill priors for both body and hand movements in a decoupled setting. The generic skill priors learn to decode a latent skill embedding into the motion of the underlying part. A high-level policy then controls hand-object interactions in these pretrained latent spaces, guided by task objectives of grasping and 3D target trajectory following. It is trained using a novel reward function that combines an adversarial style term with a task reward, encouraging natural motions while fulfilling the task incentives. Our method successfully accomplishes the complete interaction task, from approaching an object to grasping and subsequent manipulation. We compare our approach against kinematics-based baselines and show that it leads to more physically plausible motions.
関連論文
- Pixel-UMI:センサ付き人間デモンストレーションから環境認識型全身マニピュレーションを学習する全身マニピュレーション
- 全身巧みさ全身マニピュレーション
- RoboSpan: 遠隔操作による高自由度全身移動マニピュレーションのためのモジュラー協調ポリシー学習全身マニピュレーション
- PanTact: ウェアラブル接触インターフェースで全身器用さを教える全身マニピュレーション
- Praxis: 一人称視点動画から物理的相互作用の事前知識を蒸留し、汎用的な全身マニピュレーションを実現全身マニピュレーション
- 全身UMI:実時間動作生成によるヒューマノイド全身マニピュレーションへのUMIスキル転移全身マニピュレーション
