Raw2Drive: 世界モデル整合による強化学習ベースのEnd-to-End自動運転
Raw2Drive: Reinforcement Learning with Aligned World Models for End-to-End Autonomous Driving (in CARLA v2)
特権情報で訓練した世界モデルを生センサー世界モデルに蒸留し、強化学習でEnd-to-End自動運転を実現してCARLA v2で最高性能を達成した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Zhenjie Yang, Xiaosong Jia, Qifeng Li, Xue Yang, Maoqing Yao, Junchi Yan
分類: cs.RO, cs.AI, cs.CV
原文アブストラクト
Reinforcement Learning (RL) can mitigate the causal confusion and distribution shift inherent to imitation learning (IL). However, applying RL to end-to-end autonomous driving (E2E-AD) remains an open problem for its training difficulty, and IL is still the mainstream paradigm in both academia and industry. Recently Model-based Reinforcement Learning (MBRL) have demonstrated promising results in neural planning; however, these methods typically require privileged information as input rather than raw sensor data. We fill this gap by designing Raw2Drive, a dual-stream MBRL approach. Initially, we efficiently train an auxiliary privileged world model paired with a neural planner that uses privileged information as input. Subsequently, we introduce a raw sensor world model trained via our proposed Guidance Mechanism, which ensures consistency between the raw sensor world model and the privileged world model during rollouts. Finally, the raw sensor world model combines the prior knowledge embedded in the heads of the privileged world model to effectively guide the training of the raw sensor policy. Raw2Drive is so far the only RL based end-to-end method on CARLA Leaderboard 2.0, and Bench2Drive and it achieves state-of-the-art performance.
関連論文
- 蒸留サロゲートで安全クリティカルなシーンを生成し堅牢なEnd-to-End自動運転を実現End-to-End自動運転
- SC-IMMベースの教師信号によるEnd-to-End自動運転の軌道出力安定化End-to-End自動運転
- 語彙候補と拡散によるシーン適応的洗練を統合したEnd-to-End自動運転End-to-End自動運転
- 見るものを減らして運転を改善:基盤モデルの確率的パッチ選択による汎化可能なEnd-to-End自動運転End-to-End自動運転
- EgoFSD: 不確実性デノイジングと反復的洗練による効率的なEnd-to-End自動運転のための自己中心的全スパースパラダイムEnd-to-End自動運転
- 模倣学習によるEnd-to-End自動運転の交通ルール遵守を高める要因End-to-End自動運転
