実機で高速ホッピングを学ぶための「補助輪」:報酬地形を整形する実践的手法
Shaping in Practice: Training Wheels to Learn Fast Hopping Directly in Hardware
脚ロボットに一時的な物理的補助(補助輪)を取り付けて報酬地形を整形し、実機上で直接高速ホッピングを学習させる手法を実証し、効果的な補助輪設計の3基準を提案した。
著者: Steve Heim, Felix Ruppert, Alborz A. Sarvestani, Alexander Spröwitz
分類: cs.RO
原文アブストラクト
Learning instead of designing robot controllers can greatly reduce engineering effort required, while also emphasizing robustness. Despite considerable progress in simulation, applying learning directly in hardware is still challenging, in part due to the necessity to explore potentially unstable parameters. We explore the concept of shaping the reward landscape with training wheels: temporary modifications of the physical hardware that facilitate learning. We demonstrate the concept with a robot leg mounted on a boom learning to hop fast. This proof of concept embodies typical challenges such as instability and contact, while being simple enough to empirically map out and visualize the reward landscape. Based on our results we propose three criteria for designing effective training wheels for learning in robotics. A video synopsis can be found at https://youtu.be/6iH5E3LrYh8.
