Harfang3D ドッグファイト・サンドボックス:戦闘機のカスタム制御タスク向け強化学習研究プラットフォーム
Harfang3D Dog-Fight Sandbox: A Reinforcement Learning Research Platform for the Customized Control Tasks of Fighter Aircrafts
戦闘機の飛行制御やドッグファイトを強化学習で研究するための半リアルな3D飛行シミュレーション環境を提案し、指定地点への航法と近距離空戦の2タスクで学習実験を行った。
著者: Muhammed Murat Özbek, Süleyman Yıldırım, Muhammet Aksoy, Eric Kernin, Emre Koyuncu
分類: cs.RO, cs.AI
原文アブストラクト
The advent of deep learning (DL) gave rise to significant breakthroughs in Reinforcement Learning (RL) research. Deep Reinforcement Learning (DRL) algorithms have reached super-human level skills when applied to vision-based control problems as such in Atari 2600 games where environment states were extracted from pixel information. Unfortunately, these environments are far from being applicable to highly dynamic and complex real-world tasks as in autonomous control of a fighter aircraft since these environments only involve 2D representation of a visual world. Here, we present a semi-realistic flight simulation environment Harfang3D Dog-Fight Sandbox for fighter aircrafts. It is aimed to be a flexible toolbox for the investigation of main challenges in aviation studies using Reinforcement Learning. The program provides easy access to flight dynamics model, environment states, and aerodynamics of the plane enabling user to customize any specific task in order to build intelligent decision making (control) systems via RL. The software also allows deployment of bot aircrafts and development of multi-agent tasks. This way, multiple groups of aircrafts can be configured to be competitive or cooperative agents to perform complicated tasks including Dog Fight. During the experiments, we carried out training for two different scenarios: navigating to a designated location and within visual range (WVR) combat, shortly Dog Fight. Using Deep Reinforcement Learning techniques for both scenarios, we were able to train competent agents that exhibit human-like behaviours. Based on this results, it is confirmed that Harfang3D Dog-Fight Sandbox can be utilized as a 3D realistic RL research platform.
関連論文
- 強化学習による固定翼機の自律迎撃強化学習/飛行制御
- 重心再構成による劣駆動飛行船の二段階強化学習制御強化学習/飛行制御
- AcroRL: 双方向推力を用いたアグレッシブなクアッドローター反転飛行の学習強化学習/飛行制御
- クアッドロータ低レベル制御のための同変強化学習フレームワーク強化学習/飛行制御
- トンボ型タンデム翼実験機のためのConcert強化学習によるリアルタイム制御強化学習/飛行制御
- TD3によるFPVゲートを通過するクアッドコプターのニューラルネットワーク制御強化学習/飛行制御
