分布強化学習による堅牢な無人水上艇ナビゲーション
Robust Unmanned Surface Vehicle Navigation with Distributional Reinforcement Learning
海流のある環境で、流れや障害物の事前知識なしに無人水上艇を自律航行させるため、行動結果の不確実性を捉える分布強化学習ベースの局所経路計画手法を提案した。
著者: Xi Lin, John McConnell, Brendan Englot
分類: cs.RO
原文アブストラクト
Autonomous navigation of Unmanned Surface Vehicles (USV) in marine environments with current flows is challenging, and few prior works have addressed the sensorbased navigation problem in such environments under no prior knowledge of the current flow and obstacles. We propose a Distributional Reinforcement Learning (RL) based local path planner that learns return distributions which capture the uncertainty of action outcomes, and an adaptive algorithm that automatically tunes the level of sensitivity to the risk in the environment. The proposed planner achieves a more stable learning performance and converges to safer policies than a traditional RL based planner. Computational experiments demonstrate that comparing to a traditional RL based planner and classical local planning methods such as Artificial Potential Fields and the Bug Algorithm, the proposed planner is robust against environmental flows, and is able to plan trajectories that are superior in safety, time and energy consumption.
