ニアミスに着目した訓練フレームワークによる自動運転能力の動的拡張
Dynamically Expanding Capacity of Autonomous Driving with Near-Miss Focused Training Framework
シミュレータ内で報酬関数を工夫し、衝突寸前のニアミス状況を生成しながら自動運転車と背景車両を敵対的に同時訓練することで、両者の能力を段階的に高める手法を提案した。
著者: Ziyuan Yang, Zhaoyang Li, Jianming Hu, Yi Zhang
分類: cs.RO
原文アブストラクト
The long-tail distribution of real driving data poses challenges for training and testing autonomous vehicles (AV), where rare yet crucial safety-critical scenarios are infrequent. And virtual simulation offers a low-cost and efficient solution. This paper proposes a near-miss focused training framework for AV. Utilizing the driving scenario information provided by sensors in the simulator, we design novel reward functions, which enable background vehicles (BV) to generate near-miss scenarios and ensure gradients exist not only in collision-free scenes but also in collision scenarios. And then leveraging the Robust Adversarial Reinforcement Learning (RARL) framework for simultaneous training of AV and BV to gradually enhance AV and BV capabilities, as well as generating near-miss scenarios tailored to different levels of AV capabilities. Results from three testing strategies indicate that the proposed method generates scenarios closer to near-miss, thus enhancing the capabilities of both AVs and BVs throughout training.
関連論文
- 敵対的学習による信号交差点での走行ポリシーの汎化性能向上自動運転/敵対的学習
