深層強化学習による衝突回避システムの報酬関数最適化
Reward Function Optimization of a Deep Reinforcement Learning Collision Avoidance System
無人航空機の衝突回避システムにおいて、代理最適化器で報酬関数を調整することで深層強化学習の性能を向上させ、安全性と運用性を高める手法を提案した。
著者: Cooper Cone, Michael Owen, Luis Alvarez, Marc Brittain
分類: cs.AI, cs.RO
原文アブストラクト
The proliferation of unmanned aircraft systems (UAS) has caused airspace regulation authorities to examine the interoperability of these aircraft with collision avoidance systems initially designed for large transport category aircraft. Limitations in the currently mandated TCAS led the Federal Aviation Administration to commission the development of a new solution, the Airborne Collision Avoidance System X (ACAS X), designed to enable a collision avoidance capability for multiple aircraft platforms, including UAS. While prior research explored using deep reinforcement learning algorithms (DRL) for collision avoidance, DRL did not perform as well as existing solutions. This work explores the benefits of using a DRL collision avoidance system whose parameters are tuned using a surrogate optimizer. We show the use of a surrogate optimizer leads to DRL approach that can increase safety and operational viability and support future capability development for UAS collision avoidance.
