オフライン強化学習による高速道路走行軌道の最適化
Optimizing Trajectories for Highway Driving with Offline Reinforcement Learning
高速道路の自動運転向けに、オフライン強化学習で連続的な軌道パラメータを学習し、多項式ベースの滑らかな軌道を生成する手法を提案した論文。
著者: Branka Mirchevska, Moritz Werling, Joschka Boedecker
分類: cs.RO, cs.LG
原文アブストラクト
Implementing an autonomous vehicle that is able to output feasible, smooth and efficient trajectories is a long-standing challenge. Several approaches have been considered, roughly falling under two categories: rule-based and learning-based approaches. The rule-based approaches, while guaranteeing safety and feasibility, fall short when it comes to long-term planning and generalization. The learning-based approaches are able to account for long-term planning and generalization to unseen situations, but may fail to achieve smoothness, safety and the feasibility which rule-based approaches ensure. Hence, combining the two approaches is an evident step towards yielding the best compromise out of both. We propose a Reinforcement Learning-based approach, which learns target trajectory parameters for fully autonomous driving on highways. The trained agent outputs continuous trajectory parameters based on which a feasible polynomial-based trajectory is generated and executed. We compare the performance of our agent against four other highway driving agents. The experiments are conducted in the Sumo simulator, taking into consideration various realistic, dynamically changing highway scenarios, including surrounding vehicles with different driver behaviors. We demonstrate that our offline trained agent, with randomly collected data, learns to drive smoothly, achieving velocities as close as possible to the desired velocity, while outperforming the other agents. Code, training data and details available at: https://nrgit.informatik.uni-freiburg. de/branka.mirchevska/offline-rl-tp.
関連論文
- 安全フィルタリングを超えて:制御バリア関数を活用した連結自動運転車の強化学習強化学習/自動運転
- 運転意図の増幅による計画指向強化学習の性能向上強化学習/自動運転
- 実世界アジャイル運転のためのリセットフリー強化学習:実証研究強化学習/自動運転
- 減衰残差方策最適化による実世界自動運転レースの効率化強化学習/自動運転
- 報酬拡張強化学習による精密自動駐車の連続制御強化学習/自動運転
- 強化学習によるレーシングポリシーの学習強化学習/自動運転
