マルチエージェントからマルチロボットへ:マルチロボット強化学習のためのスケーラブルな訓練・評価プラットフォーム
From Multi-agent to Multi-robot: A Scalable Training and Evaluation Platform for Multi-robot Reinforcement Learning
マルチロボット強化学習のためのシミュレーション環境と実機システムを統合したSMARTプラットフォームを提案し、協調車線変更のケーススタディを通じてその実用性を示した。
著者: Zhiuxan Liang, Jiannong Cao, Shan Jiang, Divya Saxena, Jinlin Chen, Huafeng Xu
分類: cs.MA, cs.AI, cs.RO
原文アブストラクト
Multi-agent reinforcement learning (MARL) has been gaining extensive attention from academia and industries in the past few decades. One of the fundamental problems in MARL is how to evaluate different approaches comprehensively. Most existing MARL methods are evaluated in either video games or simplistic simulated scenarios. It remains unknown how these methods perform in real-world scenarios, especially multi-robot systems. This paper introduces a scalable emulation platform for multi-robot reinforcement learning (MRRL) called SMART to meet this need. Precisely, SMART consists of two components: 1) a simulation environment that provides a variety of complex interaction scenarios for training and 2) a real-world multi-robot system for realistic performance evaluation. Besides, SMART offers agent-environment APIs that are plug-and-play for algorithm implementation. To illustrate the practicality of our platform, we conduct a case study on the cooperative driving lane change scenario. Building off the case study, we summarize several unique challenges of MRRL, which are rarely considered previously. Finally, we open-source the simulation environments, associated benchmark tasks, and state-of-the-art baselines to encourage and empower MRRL research.
関連論文
- マルチロボット強化学習による地図なしナビゲーションのためのDuelingネットワークで状態価値を集中化する手法マルチロボット強化学習
- 内側注意機構による異種マルチロボット協調の適応的チーミングマルチロボット強化学習
- 集中Qネットで学習するマルチロボット分散マクロ行動ポリシーマルチロボット強化学習
