多目的深層強化学習による市街地走行
Urban Driving with Multi-Objective Deep Reinforcement Learning
閾値付き辞書式Q学習の深層学習版を都市走行に適用し、複数車線や交差点での車線変更・譲り合いを学習。因子化MDP拡張でデータ効率を改善し、環状道路へのゼロショット転移も示した。
著者: Changjian Li, Krzysztof Czarnecki
分類: cs.LG, cs.AI, cs.RO
原文アブストラクト
Autonomous driving is a challenging domain that entails multiple aspects: a vehicle should be able to drive to its destination as fast as possible while avoiding collision, obeying traffic rules and ensuring the comfort of passengers. In this paper, we present a deep learning variant of thresholded lexicographic Q-learning for the task of urban driving. Our multi-objective DQN agent learns to drive on multi-lane roads and intersections, yielding and changing lanes according to traffic rules. We also propose an extension for factored Markov Decision Processes to the DQN architecture that provides auxiliary features for the Q function. This is shown to significantly improve data efficiency. We then show that the learned policy is able to zero-shot transfer to a ring road without sacrificing performance.
