SCRIMP: 強化学習と模倣学習に基づくマルチエージェント経路探索のためのスケーラブルな通信
SCRIMP: Scalable Communication for Reinforcement- and Imitation-Learning-Based Multi-Agent Pathfinding
Transformerベースの通信機構と状態価値によるタイブレーク、内在的報酬を組み合わせ、狭い視野でも高密度なマルチエージェント経路探索を高スケールで実現する学習手法を提案。
著者: Yutong Wang, Bairan Xiang, Shinan Huang, Guillaume Sartoretti
分類: cs.RO
原文アブストラクト
Trading off performance guarantees in favor of scalability, the Multi-Agent Path Finding (MAPF) community has recently started to embrace Multi-Agent Reinforcement Learning (MARL), where agents learn to collaboratively generate individual, collision-free (but often suboptimal) paths. Scalability is usually achieved by assuming a local field of view (FOV) around the agents, helping scale to arbitrary world sizes. However, this assumption significantly limits the amount of information available to the agents, making it difficult for them to enact the type of joint maneuvers needed in denser MAPF tasks. In this paper, we propose SCRIMP, where agents learn individual policies from even very small (down to 3x3) FOVs, by relying on a highly-scalable global/local communication mechanism based on a modified transformer. We further equip agents with a state-value-based tie-breaking strategy to further improve performance in symmetric situations, and introduce intrinsic rewards to encourage exploration while mitigating the long-term credit assignment problem. Empirical evaluations on a set of experiments indicate that SCRIMP can achieve higher performance with improved scalability compared to other state-of-the-art learning-based MAPF planners with larger FOVs, and even yields similar performance as a classical centralized planner in many cases. Ablation studies further validate the effectiveness of our proposed techniques. Finally, we show that our trained model can be directly implemented on real robots for online MAPF through high-fidelity simulations in gazebo.
関連論文
- 双方向情報を用いた垂直展開によるAnyTime Conflict-Based Searchの多目的ノード選択マルチエージェント経路探索
- 超密集環境における未割当エージェントを含む記号計画とマルチエージェント経路探索マルチエージェント経路探索
- PANAMA: デジタルツイン環境におけるネットワーク考慮型マルチエージェント経路探索フレームワークマルチエージェント経路探索
- ニューラルアルゴリズミック推論器で大規模言語モデルを強化するマルチエージェント経路探索マルチエージェント経路探索
- 速度予測とリスク層を考慮した分散型マルチエージェント経路探索A*+Tマルチエージェント経路探索
- 共有探索マップに基づく協調的ハイブリッドマルチエージェント経路探索マルチエージェント経路探索
