深層強化学習を用いた自動運転の階層的意思決定アーキテクチャ
A Hierarchical Architecture for Sequential Decision-Making in Autonomous Driving using Deep Reinforcement Learning
周囲の占有グリッドを入力に深層強化学習エージェントを訓練し、車線変更などの高レベル指令を下位コントローラへ送る階層型自動運転アーキテクチャを提案した。
著者: Majid Moghadam, Gabriel Hugh Elkaim
分類: cs.RO, cs.AI, cs.LG, cs.SY, eess.SY
原文アブストラクト
Tactical decision making is a critical feature for advanced driving systems, that incorporates several challenges such as complexity of the uncertain environment and reliability of the autonomous system. In this work, we develop a multi-modal architecture that includes the environmental modeling of ego surrounding and train a deep reinforcement learning (DRL) agent that yields consistent performance in stochastic highway driving scenarios. To this end, we feed the occupancy grid of the ego surrounding into the DRL agent and obtain the high-level sequential commands (i.e. lane change) to send them to lower-level controllers. We will show that dividing the autonomous driving problem into a multi-layer control architecture enables us to leverage the AI power to solve each layer separately and achieve an admissible reliability score. Comparing with end-to-end approaches, this architecture enables us to end up with a more reliable system which can be implemented in actual self-driving cars.
