ポテンシャル場で強化した強化学習による複数ロボットの協調追跡
Multi-robot Cooperative Pursuit via Potential Field-Enhanced Reinforcement Learning
人工ポテンシャル場をルールとして強化学習に組み込み、局所観測のみで分散的に逃げる対象を協調追跡する方策を学習し、実機ロボットでも検証した論文。
著者: Zheng Zhang, Xiaohan Wang, Qingrui Zhang, Tianjiang Hu
分類: cs.RO, cs.AI, cs.MA, cs.SY, eess.SY
原文アブストラクト
It is of great challenge, though promising, to coordinate collective robots for hunting an evader in a decentralized manner purely in light of local observations. In this paper, this challenge is addressed by a novel hybrid cooperative pursuit algorithm that combines reinforcement learning with the artificial potential field method. In the proposed algorithm, decentralized deep reinforcement learning is employed to learn cooperative pursuit policies that are adaptive to dynamic environments. The artificial potential field method is integrated into the learning process as predefined rules to improve the data efficiency and generalization ability. It is shown by numerical simulations that the proposed hybrid design outperforms the pursuit policies either learned from vanilla reinforcement learning or designed by the potential field method. Furthermore, experiments are conducted by transferring the learned pursuit policies into real-world mobile robots. Experimental results demonstrate the feasibility and potential of the proposed algorithm in learning multiple cooperative pursuit strategies.
