スケーリングこそが全て:JAXで高速化した強化学習による自動運転
Scaling Is All You Need: Autonomous Driving with JAX-Accelerated Reinforcement Learning
JAXで大規模強化学習システムを構築し、実走行データを用いたシミュレータ上で自動運転ポリシーを学習。規模拡大に伴い性能が向上し、失敗率を64%削減、走行進捗を25%改善した。
著者: Moritz Harmel, Anubhav Paras, Andreas Pasternak, Nicholas Roy, Gary Linscott
分類: cs.LG, cs.AI, cs.RO
原文アブストラクト
Reinforcement learning has been demonstrated to outperform even the best humans in complex domains like video games. However, running reinforcement learning experiments on the required scale for autonomous driving is extremely difficult. Building a large scale reinforcement learning system and distributing it across many GPUs is challenging. Gathering experience during training on real world vehicles is prohibitive from a safety and scalability perspective. Therefore, an efficient and realistic driving simulator is required that uses a large amount of data from real-world driving. We bring these capabilities together and conduct large-scale reinforcement learning experiments for autonomous driving. We demonstrate that our policy performance improves with increasing scale. Our best performing policy reduces the failure rate by 64% while improving the rate of driving progress by 25% compared to the policies produced by state-of-the-art machine learning for autonomous driving.
