モデルベース最適制御からの運動模倣による脚ロボットの強化学習
Reinforcement Learning for Legged Robots: Motion Imitation from Model-Based Optimal Control
モデルベース最適制御の参照軌道を模倣して脚ロボットの俊敏な運動を学習する強化学習手法MIMOCを提案し、Mini-CheetahやMIT Humanoidで有効性を示した。
著者: AJ Miller, Shamel Fahmi, Matthew Chignoli, Sangbae Kim
分類: cs.RO
原文アブストラクト
We propose MIMOC: Motion Imitation from Model-Based Optimal Control. MIMOC is a Reinforcement Learning (RL) controller that learns agile locomotion by imitating reference trajectories from model-based optimal control. MIMOC mitigates challenges faced by other motion imitation RL approaches because the references are dynamically consistent, require no motion retargeting, and include torque references. Hence, MIMOC does not require fine-tuning. MIMOC is also less sensitive to modeling and state estimation inaccuracies than model-based controllers. We validate MIMOC on the Mini-Cheetah in outdoor environments over a wide variety of challenging terrain, and on the MIT Humanoid in simulation. We show cases where MIMOC outperforms model-based optimal controllers, and show that imitating torque references improves the policy's performance.
