交通流ランダム化を用いた強化学習による自動運転の意思決定と制御
Autonomous vehicle decision and control through reinforcement learning with traffic flow randomization
SUMOの交通流モデルのパラメータをランダム化して周囲車両の挙動を多様化し、深層強化学習で自動運転方策を訓練することで、より現実的な交通環境での性能劣化を抑える手法を提案した。
著者: Yuan Lin, Antai Xie, Xiao Liu
分類: eess.SY, cs.LG, cs.RO, cs.SY
原文アブストラクト
Most of the current studies on autonomous vehicle decision-making and control tasks based on reinforcement learning are conducted in simulated environments. The training and testing of these studies are carried out under rule-based microscopic traffic flow, with little consideration of migrating them to real or near-real environments to test their performance. It may lead to a degradation in performance when the trained model is tested in more realistic traffic scenes. In this study, we propose a method to randomize the driving style and behavior of surrounding vehicles by randomizing certain parameters of the car-following model and the lane-changing model of rule-based microscopic traffic flow in SUMO. We trained policies with deep reinforcement learning algorithms under the domain randomized rule-based microscopic traffic flow in freeway and merging scenes, and then tested them separately in rule-based microscopic traffic flow and high-fidelity microscopic traffic flow. Results indicate that the policy trained under domain randomization traffic flow has significantly better success rate and calculative reward compared to the models trained under other microscopic traffic flows.
