実世界の動的環境に向けた深層強化学習ナビゲーション
Deep reinforcement learning oriented for real world dynamic scenarios
ロボット中心の速度空間モデルに深層強化学習を適用し、カリキュラム学習と高忠実度シミュレータで訓練することで、動的環境での自律ナビゲーションを実現した研究。
著者: Diego Martinez, Luis Riazuelo, Luis Montano
分類: cs.RO
原文アブストラクト
Autonomous navigation in dynamic environments is a complex but essential task for autonomous robots. Recent deep reinforcement learning approaches show promising results to solve the problem, but it is not solved yet, as they typically assume no robot kinodynamic restrictions, holonomic movement or perfect environment knowledge. Moreover, most algorithms fail in the real world due to the inability to generate real-world training data for the huge variability of possible scenarios. In this work, we present a novel planner, DQN-DOVS, that uses deep reinforcement learning on a descriptive robocentric velocity space model to navigate in highly dynamic environments. It is trained using a smart curriculum learning approach on a simulator that faithfully reproduces the real world, reducing the gap between the reality and simulation. We test the resulting algorithm in scenarios with different number of obstacles and compare it with many state-of-the-art approaches, obtaining a better performance. Finally, we try the algorithm in a ground robot, using the same setup as in the simulation experiments.
