副詞を用いたパラメータ化スキルの誘導方策探索
Guided Policy Search for Parameterized Skills using Adverbs
人間が与える副詞のフィードバックからスキルパラメータを調整する手法を提案し、密な報酬がない状況でも従来の方策探索の代替として機能することを示した。
著者: Benjamin A. Spiegel, George Konidaris
分類: cs.AI, cs.CL, cs.HC, cs.RO
原文アブストラクト
We present a method for using adverb phrases to adjust skill parameters via learned adverb-skill groundings. These groundings allow an agent to use adverb feedback provided by a human to directly update a skill policy, in a manner similar to traditional local policy search methods. We show that our method can be used as a drop-in replacement for these policy search methods when dense reward from the environment is not available but human language feedback is. We demonstrate improved sample efficiency over modern policy search methods in two experiments.
