SimScale: 実世界シミュレーションを大規模に活用した自動運転の学習
SimScale: Learning to Drive via Real-World Simulation at Scale
既存の走行ログから大規模に未知の状態を合成するシミュレーション基盤を構築し、疑似専門家による行動監督と実データとの共同学習で計画性能の堅牢性と汎化を大幅に向上させた。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Haochen Tian, Tianyu Li, Haochen Liu, Jiazhi Yang, Yihang Qiu, Guang Li, Junli Wang, Yinfeng Gao, Zhang Zhang, Liang Wang, Hangjun Ye, Tieniu Tan, Long Chen, Hongyang Li
分類: cs.CV, cs.RO
原文アブストラクト
Achieving fully autonomous driving systems requires learning rational decisions in a wide span of scenarios, including safety-critical and out-of-distribution ones. However, such cases are underrepresented in real-world corpus collected by human experts. To complement for the lack of data diversity, we introduce a novel and scalable simulation framework capable of synthesizing massive unseen states upon existing driving logs. Our pipeline utilizes advanced neural rendering with a reactive environment to generate high-fidelity multi-view observations controlled by the perturbed ego trajectory. Furthermore, we develop a pseudo-expert trajectory generation mechanism for these newly simulated states to provide action supervision. Upon the synthesized data, we find that a simple co-training strategy on both real-world and simulated samples can lead to significant improvements in both robustness and generalization for various planning methods on challenging real-world benchmarks, up to +8.6 EPDMS on navhard and +2.9 on navtest. More importantly, such policy improvement scales smoothly by increasing simulation data only, even without extra real-world data streaming in. We further reveal several crucial findings of such a sim-real learning system, which we term SimScale, including the design of pseudo-experts and the scaling properties for different policy architectures. Simulation data and code have been released at https://github.com/OpenDriveLab/SimScale.
関連論文
- 町をまたいだ夢見:セマンティック・ロールアウトと町敵対的正則化によるCARLAでの未見町固定ルート運転のゼロショット転移自動運転/sim2real
- Sim2Real-AD: VLM誘導強化学習を実車の自動運転に展開するためのモジュール型Sim-to-Realフレームワーク自動運転/sim2real
- 地下駐車場シミュレーションにおける自動バレーパーキングアルゴリズム訓練の評価手法の検討自動運転/sim2real
- Sim-on-Wheels: 自動運転のための物理世界をループに含むシミュレーション自動運転/sim2real
- シミュレーションを超えて:大規模自律走行車の堅牢性と回復力への道自動運転/sim2real
- 高速道路輸送のためのインテリジェント自動運転トラックシステム自動運転/sim2real
