拡散モデルと強化学習を統合した階層型追跡回避ゲームの運動計画
Diffusion-Reinforcement Learning Hierarchical Motion Planning in Multi-agent Adversarial Games
部分的に観測可能なマルチエージェント追跡回避ゲームにおいて、高レベル拡散モデルで大域経路を計画し、低レベル強化学習で回避行動を決定する階層的アーキテクチャを提案し、ベースラインを大幅に上回る性能を達成した。
著者: Zixuan Wu, Sean Ye, Manisha Natarajan, Matthew C. Gombolay
分類: cs.RO, cs.LG, cs.MA
原文アブストラクト
Reinforcement Learning (RL)-based motion planning has recently shown the potential to outperform traditional approaches from autonomous navigation to robot manipulation. In this work, we focus on a motion planning task for an evasive target in a partially observable multi-agent adversarial pursuit-evasion game (PEG). Pursuit-evasion problems are relevant to various applications, such as search and rescue operations and surveillance robots, where robots must effectively plan their actions to gather intelligence or accomplish mission tasks while avoiding detection or capture. We propose a hierarchical architecture that integrates a high-level diffusion model to plan global paths responsive to environment data, while a low-level RL policy reasons about evasive versus global path-following behavior. The benchmark results across different domains and different observability show that our approach outperforms baselines by 77.18% and 47.38% on detection and goal reaching rate, which leads to 51.4% increasing of the performance score on average. Additionally, our method improves interpretability, flexibility and efficiency of the learned policy.
関連論文
- ロボサッカーチームのためのスケーラブルで俊敏な動的運動計画の学習に向けた方策最適化マルチエージェント運動計画
- 一般化ナッシュ均衡から学ぶ2エージェント運動計画戦略のMPCマルチエージェント運動計画
