PRIMAL2: 強化学習と模倣学習による生涯マルチエージェント経路探索
PRIMAL2: Pathfinding via Reinforcement and Imitation Multi-Agent Learning -- Lifelong
密で構造化された環境での生涯MAPF(LMAPF)に対し、エージェントが完全分散方策を学習して反応的に経路計画する強化学習フレームワークPRIMAL2を提案し、最先端プランナを上回る性能を示した。
著者: Mehul Damani, Zhiyao Luo, Emerson Wenzel, Guillaume Sartoretti
分類: cs.RO
原文アブストラクト
Multi-agent path finding (MAPF) is an indispensable component of large-scale robot deployments in numerous domains ranging from airport management to warehouse automation. In particular, this work addresses lifelong MAPF (LMAPF) - an online variant of the problem where agents are immediately assigned a new goal upon reaching their current one - in dense and highly structured environments, typical of real-world warehouse operations. Effectively solving LMAPF in such environments requires expensive coordination between agents as well as frequent replanning abilities, a daunting task for existing coupled and decoupled approaches alike. With the purpose of achieving considerable agent coordination without any compromise on reactivity and scalability, we introduce PRIMAL2, a distributed reinforcement learning framework for LMAPF where agents learn fully decentralized policies to reactively plan paths online in a partially observable world. We extend our previous work, which was effective in low-density sparsely occupied worlds, to highly structured and constrained worlds by identifying behaviors and conventions which improve implicit agent coordination, and enable their learning through the construction of a novel local agent observation and various training aids. We present extensive results of PRIMAL2 in both MAPF and LMAPF environments and compare its performance to state-of-the-art planners in terms of makespan and throughput. We show that PRIMAL2 significantly surpasses our previous work and performs comparably to these baselines, while allowing real-time re-planning and scaling up to 2048 agents.
関連論文
- 双方向情報を用いた垂直展開によるAnyTime Conflict-Based Searchの多目的ノード選択マルチエージェント経路探索
- 超密集環境における未割当エージェントを含む記号計画とマルチエージェント経路探索マルチエージェント経路探索
- PANAMA: デジタルツイン環境におけるネットワーク考慮型マルチエージェント経路探索フレームワークマルチエージェント経路探索
- ニューラルアルゴリズミック推論器で大規模言語モデルを強化するマルチエージェント経路探索マルチエージェント経路探索
- 速度予測とリスク層を考慮した分散型マルチエージェント経路探索A*+Tマルチエージェント経路探索
- 共有探索マップに基づく協調的ハイブリッドマルチエージェント経路探索マルチエージェント経路探索
