ベアリング情報のみを用いた協調的ターゲット追跡:マルチエージェント強化学習の設計と実験
Cooperative Bearing-Only Target Pursuit via Multiagent Reinforcement Learning: Design and Experiment
ベアリング情報のみで未知ターゲットを推定・追跡するため、均一ベアリング情報フィルタと異種車両対応のマルチエージェント強化学習を提案し、sim-to-realギャップを低減して実機へゼロショット転移を実現した。
著者: Jianan Li, Zhikun Wang, Susheng Ding, Shiliang Guo, Shiyu Zhao
分類: cs.MA, cs.RO, cs.SY, eess.SY
原文アブストラクト
This paper addresses the multi-robot pursuit problem for an unknown target, encompassing both target state estimation and pursuit control. First, in state estimation, we focus on using only bearing information, as it is readily available from vision sensors and effective for small, distant targets. Challenges such as instability due to the nonlinearity of bearing measurements and singularities in the two-angle representation are addressed through a proposed uniform bearing-only information filter. This filter integrates multiple 3D bearing measurements, provides a concise formulation, and enhances stability and resilience to target loss caused by limited field of view (FoV). Second, in target pursuit control within complex environments, where challenges such as heterogeneity and limited FoV arise, conventional methods like differential games or Voronoi partitioning often prove inadequate. To address these limitations, we propose a novel multiagent reinforcement learning (MARL) framework, enabling multiple heterogeneous vehicles to search, localize, and follow a target while effectively handling those challenges. Third, to bridge the sim-to-real gap, we propose two key techniques: incorporating adjustable low-level control gains in training to replicate the dynamics of real-world autonomous ground vehicles (AGVs), and proposing spectral-normalized RL algorithms to enhance policy smoothness and robustness. Finally, we demonstrate the successful zero-shot transfer of the MARL controllers to AGVs, validating the effectiveness and practical feasibility of our approach. The accompanying video is available at https://youtu.be/HO7FJyZiJ3E.
