UAVの自律航法・地図構築・目標検出のための強化学習
Reinforcement Learning for UAV Autonomous Navigation, Mapping and Target Detection
低コストレーダーを搭載したUAVが未知環境で地図精度を最大化しつつ目標検出に有効な領域を探索する航路を、強化学習で学習する手法を提案した。
著者: Anna Guerra, Francesco Guidi, Davide Dardari, Petar M. Djuric
分類: cs.RO, cs.LG, eess.SP, stat.ML
原文アブストラクト
In this paper, we study a joint detection, mapping and navigation problem for a single unmanned aerial vehicle (UAV) equipped with a low complexity radar and flying in an unknown environment. The goal is to optimize its trajectory with the purpose of maximizing the mapping accuracy and, at the same time, to avoid areas where measurements might not be sufficiently informative from the perspective of a target detection. This problem is formulated as a Markov decision process (MDP) where the UAV is an agent that runs either a state estimator for target detection and for environment mapping, and a reinforcement learning (RL) algorithm to infer its own policy of navigation (i.e., the control law). Numerical results show the feasibility of the proposed idea, highlighting the UAV's capability of autonomously exploring areas with high probability of target detection while reconstructing the surrounding environment.
