運転戦略を効率的に開発:スキルベース階層型強化学習アプローチ
Developing Driving Strategies Efficiently: A Skill-Based Hierarchical Reinforcement Learning Approach
運転戦略を効率的に学習するため、運動プリミティブ(スキル)を高レベル行動として用いる階層型強化学習を提案し、合流シナリオで従来手法より少ない学習で高性能な運転モデルを実現した。
著者: Yigit Gurses, Kaan Buyukdemirci, Yildiray Yildiz
分類: cs.LG, cs.AI, cs.RO
原文アブストラクト
Driving in dense traffic with human and autonomous drivers is a challenging task that requires high-level planning and reasoning. Human drivers can achieve this task comfortably, and there has been many efforts to model human driver strategies. These strategies can be used as inspirations for developing autonomous driving algorithms or to create high-fidelity simulators. Reinforcement learning is a common tool to model driver policies, but conventional training of these models can be computationally expensive and time-consuming. To address this issue, in this paper, we propose ``skill-based" hierarchical driving strategies, where motion primitives, i.e. skills, are designed and used as high-level actions. This reduces the training time for applications that require multiple models with varying behavior. Simulation results in a merging scenario demonstrate that the proposed approach yields driver models that achieve higher performance with less training compared to baseline reinforcement learning methods.
