運行総コストに基づく報酬を用いた深層強化学習による自動運転トラックの戦術的意思決定
Tactical Decision Making for Autonomous Trucks by Deep Reinforcement Learning with Total Cost of Operation Based Reward
高速道路での自動運転トラックのACCと車線変更を対象に、運行総コスト(TCOP)を報酬設計に組み込んだ深層強化学習フレームワークを構築し、高レベル意思決定と低レベル制御を分離する手法を検討した。
著者: Deepthi Pathare, Leo Laine, Morteza Haghir Chehreghani
分類: cs.LG, cs.AI, cs.RO
原文アブストラクト
We develop a deep reinforcement learning framework for tactical decision making in an autonomous truck, specifically for Adaptive Cruise Control (ACC) and lane change maneuvers in a highway scenario. Our results demonstrate that it is beneficial to separate high-level decision-making processes and low-level control actions between the reinforcement learning agent and the low-level controllers based on physical models. In the following, we study optimizing the performance with a realistic and multi-objective reward function based on Total Cost of Operation (TCOP) of the truck using different approaches; by adding weights to reward components, by normalizing the reward components and by using curriculum learning techniques.
