戦略的内在的動機付け学習による相互関連タスク群の運動ポリシー列学習
Learning a Set of Interrelated Tasks by Using Sequences of Motor Policies for a Strategic Intrinsically Motivated Learner
ロボットが自らの進捗に基づきポリシー空間と手続き空間の探索を切り替え、既習スキルを組み合わせた運動ポリシー列(手続き)を自律的に獲得して階層的複合タスクを学習するアーキテクチャを提案した。
著者: Nicolas Duminy, Sao Mai Nguyen, Dominique Duhaut
分類: cs.HC, cs.AI, cs.RO
原文アブストラクト
We propose an active learning architecture for robots, capable of organizing its learning process to achieve a field of complex tasks by learning sequences of motor policies, called Intrinsically Motivated Procedure Babbling (IM-PB). The learner can generalize over its experience to continuously learn new tasks. It chooses actively what and how to learn based by empirical measures of its own progress. In this paper, we are considering the learning of a set of interrelated tasks outcomes hierarchically organized. We introduce a framework called 'procedures', which are sequences of policies defined by the combination of previously learned skills. Our algorithmic architecture uses the procedures to autonomously discover how to combine simple skills to achieve complex goals. It actively chooses between 2 strategies of goal-directed exploration : exploration of the policy space or the procedural space. We show on a simulated environment that our new architecture is capable of tackling the learning of complex motor policies, to adapt the complexity of its policies to the task at hand. We also show that our 'procedures' framework helps the learner to tackle difficult hierarchical tasks.
