観測者と回避目標の共訓練:マルチエージェント強化学習によるUAV追跡
Co-Training an Observer and an Evading Target
UAV追跡シナリオで観測側と回避側の政策をマルチエージェント強化学習により同時に訓練し、ベースラインを上回る性能を達成するとともに、特徴量重要度と決定木による解釈可能な政策を提示した。
著者: André Brandenburger, Folker Hoffmann, Alexander Charlish
分類: cs.RO
原文アブストラクト
Reinforcement learning (RL) is already widely applied to applications such as robotics, but it is only sparsely used in sensor management. In this paper, we apply the popular Proximal Policy Optimization (PPO) approach to a multi-agent UAV tracking scenario. While recorded data of real scenarios can accurately reflect the real world, the required amount of data is not always available. Simulation data, however, is typically cheap to generate, but the utilized target behavior is often naive and only vaguely represents the real world. In this paper, we utilize multi-agent RL to jointly generate protagonistic and antagonistic policies and overcome the data generation problem, as the policies are generated on-the-fly and adapt continuously. This way, we are able to clearly outperform baseline methods and robustly generate competitive policies. In addition, we investigate explainable artificial intelligence (XAI) by interpreting feature saliency and generating an easy-to-read decision tree as a simplified policy.
