単眼視とDueling Double Deep Recurrent Q-learningによるクアッドロータの自律障害物回避
Autonomous quadrotor obstacle avoidance based on dueling double deep recurrent Q-learning with monocular vision
単眼カメラのみを搭載したクアッドロータが、教師なし学習の知覚モジュールとDueling Double Deep Recurrent Q-learningの意思決定モジュールの二段構成で、事前環境情報やラベル付きデータなしに自律障害物回避を実現した。
著者: Jiajun Ou, Xiao Guo, Ming Zhu, Wenjie Lou
分類: eess.SY, cs.RO, cs.SY
原文アブストラクト
The rapid development of unmanned aerial vehicles (UAV) puts forward a higher requirement for autonomous obstacle avoidance. Due to the limited payload and power supply, small UAVs such as quadrotors usually carry simple sensors and computation units, which makes traditional methods more challenging to implement. In this paper, a novel framework is demonstrated to control a quadrotor flying through crowded environments autonomously with monocular vision. The framework adopts a two-stage architecture, consisting of a sensing module and a decision module. The sensing module is based on an unsupervised deep learning method. And the decision module uses dueling double deep recurrent Q-learning to eliminate the adverse effects of limited observation capacity of an on-board monocular camera. The framework enables the quadrotor to realize autonomous obstacle avoidance without any prior environment information or labeled datasets for training. The trained model shows a high success rate in the simulation and a good generalization ability for transformed scenarios.
関連論文
- 衝突リスク評価による強化学習ベースの動的障害物回避の改良手法強化学習/障害物回避
- 深層強化学習による連続行動空間での小型無人航空機の障害物回避強化学習/障害物回避
- 単眼視による障害物回避のための深層強化学習強化学習/障害物回避
