競合強化学習を用いた飛行標的の俊敏な迎撃
Agile Interception of a Flying Target using Competitive Reinforcement Learning
本論文は、捕獲ネットを搭載したドローンが別の俊敏なドローンを迎撃する問題を競合強化学習として定式化し、PPOで訓練したポリシーがヒューリスティックなベースラインを上回る性能を示し、実機でも検証した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Timothée Gavin, Simon Lacroix, Murat Bronz
分類: cs.RO, stat.ML
原文アブストラクト
This article presents a solution to intercept an agile drone by another agile drone carrying a catching net. We formulate the interception as a Competitive Reinforcement Learning problem, where the interceptor and the target drone are controlled by separate policies trained with Proximal Policy Optimization (PPO). We introduce a high-fidelity simulation environment that integrates a realistic quadrotor dynamics model and a low-level control architecture implemented in JAX, which allows for fast parallelized execution on GPUs. We train the agents using low-level control, collective thrust and body rates, to achieve agile flights both for the interceptor and the target. We compare the performance of the trained policies in terms of catch rate, time to catch, and crash rate, against common heuristic baselines and show that our solution outperforms these baselines for interception of agile targets. Finally, we demonstrate the performance of the trained policies in a scaled real-world scenario using agile drones inside an indoor flight arena.
