MCMC法による模倣学習アルゴリズムの改善
Towards Improving Learning from Demonstration Algorithms via MCMC Methods
模倣学習に暗黙的エネルギーベース方策モデルを導入し、不連続・マルチモーダルな方策の近似で従来の明示的NNモデルより平均的に優れることを示した。
著者: Carl Qi, Edward Sun, Harry Zhang
分類: cs.RO
原文アブストラクト
Behavioral cloning, or more broadly, learning from demonstrations (LfD) is a priomising direction for robot policy learning in complex scenarios. Albeit being straightforward to implement and data-efficient, behavioral cloning has its own drawbacks, limiting its efficacy in real robot setups. In this work, we take one step towards improving learning from demonstration algorithms by leveraging implicit energy-based policy models. Results suggest that in selected complex robot policy learning scenarios, treating supervised policy learning with an implicit model generally performs better, on average, than commonly used neural network-based explicit models, especially in the cases of approximating potentially discontinuous and multimodal functions.
