深層強化学習による短時間高高度気球の季節別定位置保持
Seasonal Station-Keeping of Short Duration High Altitude Balloons using Deep Reinforcement Learning
深層Q学習を用いて、季節ごとに変化する風環境下で短時間高高度気球を目標領域に留める経路計画を訓練・評価し、予報スコアで風の多様性と成功率の関係を分析した。
著者: Tristan K. Schuler, Chinthan Prasad, Georgiy Kiselev, Donald Sofge
分類: cs.LG, cs.RO, physics.ao-ph
原文アブストラクト
Station-Keeping short-duration high-altitude balloons (HABs) in a region of interest is a challenging path-planning problem due to partially observable, complex, and dynamic wind flows. Deep reinforcement learning is a popular strategy for solving the station-keeping problem. A custom simulation environment was developed to train and evaluate Deep Q-Learning (DQN) for short-duration HAB agents in the simulation. To train the agents on realistic winds, synthetic wind forecasts were generated from aggregated historical radiosonde data to apply horizontal kinematics to simulated agents. The synthetic forecasts were closely correlated with ECWMF ERA5 Reanalysis forecasts, providing a realistic simulated wind field and seasonal and altitudinal variances between the wind models. DQN HAB agents were then trained and evaluated across different seasonal months. To highlight differences and trends in months with vastly different wind fields, a Forecast Score algorithm was introduced to independently classify forecasts based on wind diversity, and trends between station-keeping success and the Forecast Score were evaluated across all seasons.
関連論文
- 低視界環境における強化学習ベースの避難経路生成強化学習/経路計画
- データ効率の良い深層強化学習によるUASミッション再計画のためのマルチスタートチームオリエンテーリング問題強化学習/経路計画
- 自律型車両による距離のみの水中目標位置推定のための強化学習経路計画手法強化学習/経路計画
- 深層強化学習による自律表面艇の経路追従と衝突回避の制御強化学習/経路計画
