適応的模倣:実行不可能な参照からパラメータ化二足歩行を深層強化学習で獲得
Adaptive Mimic: Deep Reinforcement Learning of Parameterized Bipedal Walking from Infeasible References
低品質で単体では実行不可能な参照動作を事前知識として活用し、性能に応じて模倣と高性能追求を切り替える適応的報酬関数でパラメータ化二足歩行を学習する手法を提案した。
著者: Chong Zhang, Qi Wu, Liqian Ma, Hongyuan Su
分類: cs.RO
原文アブストラクト
Not until recently, robust robot locomotion has been achieved by deep reinforcement learning (DRL). However, for efficient learning of parametrized bipedal walking, developed references are usually required, limiting the performance to that of the references. In this paper, we propose to design an adaptive reward function for imitation learning from the references. The agent is encouraged to mimic the references when its performance is low, while to pursue high performance when it reaches the limit of references. We further demonstrate that developed references can be replaced by low-quality references that are generated without laborious tuning and infeasible to deploy by themselves, as long as they can provide a priori knowledge to expedite the learning process.
