強化学習と分散モデル予測制御による高制約空間でのコンフリクト解消
Reinforcement Learning and Distributed Model Predictive Control for Conflict Resolution in Highly Constrained Spaces
強化学習で訓練した方策と分散MPCを組み合わせ、狭い空間で複数車両が安全かつ効率的に衝突を回避しながら目的地へ向かう手法を提案した。
著者: Xu Shen, Francesco Borrelli
分類: cs.RO, cs.SY, eess.SY
原文アブストラクト
This work presents a distributed algorithm for resolving cooperative multi-vehicle conflicts in highly constrained spaces. By formulating the conflict resolution problem as a Multi-Agent Reinforcement Learning (RL) problem, we can train a policy offline to drive the vehicles towards their destinations safely and efficiently in a simplified discrete environment. During the online execution, each vehicle first simulates the interaction among vehicles with the trained policy to obtain its strategy, which is used to guide the computation of a reference trajectory. A distributed Model Predictive Controller (MPC) is then proposed to track the reference while avoiding collisions. The preliminary results show that the combination of RL and distributed MPC has the potential to guide vehicles to resolve conflicts safely and smoothly while being less computationally demanding than the centralized approach.
