rSoccer: 小型ロボットサッカーで強化学習を研究するためのフレームワーク
rSoccer: A Framework for Studying Reinforcement Learning in Small and Very Small Size Robot Soccer
IEEE Very Small Size SoccerとSmall Size League向けの強化学習実験に最適化したオープンソースシミュレータと、単一・複数エージェントのサッカースキル評価用ベンチマークを備えたOpenAI Gym環境構築フレームワークを提案し、最先端強化学習手法の学習能力と限界を示した。
著者: Felipe B. Martins, Mateus G. Machado, Hansenclever F. Bassani, Pedro H. M. Braga, Edna S. Barros
分類: cs.LG, cs.AI, cs.RO
原文アブストラクト
Reinforcement learning is an active research area with a vast number of applications in robotics, and the RoboCup competition is an interesting environment for studying and evaluating reinforcement learning methods. A known difficulty in applying reinforcement learning to robotics is the high number of experience samples required, being the use of simulated environments for training the agents followed by transfer learning to real-world (sim-to-real) a viable path. This article introduces an open-source simulator for the IEEE Very Small Size Soccer and the Small Size League optimized for reinforcement learning experiments. We also propose a framework for creating OpenAI Gym environments with a set of benchmarks tasks for evaluating single-agent and multi-agent robot soccer skills. We then demonstrate the learning capabilities of two state-of-the-art reinforcement learning methods as well as their limitations in certain scenarios introduced in this framework. We believe this will make it easier for more teams to compete in these categories using end-to-end reinforcement learning approaches and further develop this research area.
