経験学習に着想を得た二段階報酬法による脚式ロボットの効率的な自然で頑健な歩容学習
Experience-Learning Inspired Two-Step Reward Method for Efficient Legged Locomotion Learning Towards Natural and Robust Gaits
動物の段階的学習に倣い、平坦地での歩容学習と敵対的模倣学習を組み合わせた二段階報酬フレームワークで、脚式ロボットに自然で頑健な歩容を効率的に獲得させ、実機GO1で検証した。
著者: Yinghui Li, Jinze Wu, Xin Liu, Weizhong Guo, Yufei Xue
分類: cs.RO
原文アブストラクト
Multi-legged robots offer enhanced stability in complex terrains, yet autonomously learning natural and robust motions in such environments remains challenging. Drawing inspiration from animals' progressive learning patterns, from simple to complex tasks, we introduce a universal two-stage learning framework with two-step reward setting based on self-acquired experience, which efficiently enables legged robots to incrementally learn natural and robust movements. In the first stage, robots learn through gait-related rewards to track velocity on flat terrain, acquiring natural, robust movements and generating effective motion experience data. In the second stage, mirroring animal learning from existing experiences, robots learn to navigate challenging terrains with natural and robust movements using adversarial imitation learning. To demonstrate our method's efficacy, we trained both quadruped robots and a hexapod robot, and the policy were successfully transferred to a physical quadruped robot GO1, which exhibited natural gait patterns and remarkable robustness in various terrains.
