イベントトリガ型通信と合意形成制御の深層強化学習による分散協調搬送
Deep reinforcement learning of event-triggered communication and consensus-based control for distributed cooperative transport
マルチエージェント強化学習で、近傍エージェントと合力・トルクを合意形成しつつ通信タイミングを学習し、訓練時と台数が異なる状況でも協調搬送を可能にする手法を提案。
著者: Kazuki Shibata, Tomohiko Jimbo, Takamitsu Matsubara
分類: cs.RO
原文アブストラクト
In this paper, we present a solution to a design problem of control strategies for multi-agent cooperative transport. Although existing learning-based methods assume that the number of agents is the same as that in the training environment, the number might differ in reality considering that the robots' batteries may completely discharge, or additional robots may be introduced to reduce the time required to complete a task. Therefore, it is crucial that the learned strategy be applicable to scenarios wherein the number of agents differs from that in the training environment. In this paper, we propose a novel multi-agent reinforcement learning framework of event-triggered communication and consensus-based control for distributed cooperative transport. The proposed policy model estimates the resultant force and torque in a consensus manner using the estimates of the resultant force and torque with the neighborhood agents. Moreover, it computes the control and communication inputs to determine when to communicate with the neighboring agents under local observations and estimates of the resultant force and torque. Therefore, the proposed framework can balance the control performance and communication savings in scenarios wherein the number of agents differs from that in the training environment. We confirm the effectiveness of our approach by using a maximum of eight and six robots in the simulations and experiments, respectively.
