強化学習による行動計画とサンプリングベース運動計画の統合による自動運転
Integration of Reinforcement Learning Based Behavior Planning With Sampling Based Motion Planning for Automated Driving
深層強化学習を高レベル行動計画に用い、サンプリングベース運動計画と組み合わせることで、実車での自動運転を実現する手法を提案した。
著者: Marvin Klimke, Benjamin Völz, Michael Buchholz
分類: cs.RO, cs.LG
原文アブストラクト
Reinforcement learning has received high research interest for developing planning approaches in automated driving. Most prior works consider the end-to-end planning task that yields direct control commands and rarely deploy their algorithm to real vehicles. In this work, we propose a method to employ a trained deep reinforcement learning policy for dedicated high-level behavior planning. By populating an abstract objective interface, established motion planning algorithms can be leveraged, which derive smooth and drivable trajectories. Given the current environment model, we propose to use a built-in simulator to predict the traffic scene for a given horizon into the future. The behavior of automated vehicles in mixed traffic is determined by querying the learned policy. To the best of our knowledge, this work is the first to apply deep reinforcement learning in this manner, and as such lacks a state-of-the-art benchmark. Thus, we validate the proposed approach by comparing an idealistic single-shot plan with cyclic replanning through the learned policy. Experiments with a real testing vehicle on proving grounds demonstrate the potential of our approach to shrink the simulation to real world gap of deep reinforcement learning based planning approaches. Additional simulative analyses reveal that more complex multi-agent maneuvers can be managed by employing the cycling replanning approach.
