生成時系列モデルによる確率的交通環境の構築:自動運転エージェントの汎化性能向上に向けて
Development of A Stochastic Traffic Environment with Generative Time-Series Models for Improving Generalization Capabilities of Autonomous Driving Agents
実走行軌跡データでGANを学習させ、現実に近い確率的交通シミュレータを構築し、そこで強化学習した車線変更エージェントが単純なルールベース環境より高い汎化性能を示すことを示した論文。
著者: Anil Ozturk, Mustafa Burak Gunel, Melih Dal, Ugur Yavas, Nazim Kemal Ure
分類: cs.RO, cs.AI, eess.SP
原文アブストラクト
Automated lane changing is a critical feature for advanced autonomous driving systems. In recent years, reinforcement learning (RL) algorithms trained on traffic simulators yielded successful results in computing lane changing policies that strike a balance between safety, agility and compensating for traffic uncertainty. However, many RL algorithms exhibit simulator bias and policies trained on simple simulators do not generalize well to realistic traffic scenarios. In this work, we develop a data driven traffic simulator by training a generative adverserial network (GAN) on real life trajectory data. The simulator generates randomized trajectories that resembles real life traffic interactions between vehicles, which enables training the RL agent on much richer and realistic scenarios. We demonstrate through simulations that RL agents that are trained on GAN-based traffic simulator has stronger generalization capabilities compared to RL agents trained on simple rule-driven simulators.
関連論文
- 効率的かつ転移可能な制御学習のためのダイナミクス蒸留自動運転/強化学習/sim2real
- 深層強化学習による実世界の自動運転への挑戦自動運転/強化学習/sim2real
