階層型深層強化学習による適応的で説明可能なナビゲーションスキルの展開
Adaptive and Explainable Deployment of Navigation Skills via Hierarchical Deep Reinforcement Learning
多様な報酬関数で低レベルナビゲーション方策群を学習し、高レベル方策が状況に応じて最適なスキルを適応的に選択・展開する階層型強化学習フレームワークを提案した。
著者: Kyowoon Lee, Seongun Kim, Jaesik Choi
分類: cs.RO
原文アブストラクト
For robotic vehicles to navigate robustly and safely in unseen environments, it is crucial to decide the most suitable navigation policy. However, most existing deep reinforcement learning based navigation policies are trained with a hand-engineered curriculum and reward function which are difficult to be deployed in a wide range of real-world scenarios. In this paper, we propose a framework to learn a family of low-level navigation policies and a high-level policy for deploying them. The main idea is that, instead of learning a single navigation policy with a fixed reward function, we simultaneously learn a family of policies that exhibit different behaviors with a wide range of reward functions. We then train the high-level policy which adaptively deploys the most suitable navigation skill. We evaluate our approach in simulation and the real world and demonstrate that our method can learn diverse navigation skills and adaptively deploy them. We also illustrate that our proposed hierarchical learning framework presents explainability by providing semantics for the behavior of an autonomous agent.
