深層決定論的方策勾配によるマルチビークル群れ制御
Multi-vehicle Flocking Control with Deep Deterministic Policy Gradient Method
集中訓練・分散実行のDDPGを用い、衝突回避と通信維持を考慮したマルチビークル群れ制御を実現した研究。
著者: Yang Lyu, Quan Pan, Jinwen Hu, Chunhui Zhao, Shuai Liu
分類: cs.RO
原文アブストラクト
Flocking control has been studied extensively along with the wide application of multi-vehicle systems. In this paper the Multi-vehicles System (MVS) flocking control with collision avoidance and communication preserving is considered based on the deep reinforcement learning framework. Specifically the deep deterministic policy gradient (DDPG) with centralized training and distributed execution process is implemented to obtain the flocking control policy. First, to avoid the dynamically changed observation of state, a three layers tensor based representation of the observation is used so that the state remains constant although the observation dimension is changing. A reward function is designed to guide the way-points tracking, collision avoidance and communication preserving. The reward function is augmented by introducing the local reward function of neighbors. Finally, a centralized training process which trains the shared policy based on common training set among all agents. The proposed method is tested under simulated scenarios with different setup.
