自動運転における動画生成と世界モデルの相互作用の探求:サーベイ
Exploring the Interplay Between Video Generation and World Models in Autonomous Driving: A Survey
自動運転における世界モデルと動画生成技術の関係を調査し、拡散モデルを中心とした構造的類似性や評価指標、課題と今後の研究方向を整理したサーベイ論文。
著者: Ao Fu, Yi Zhou, Tao Zhou, Yi Yang, Bojun Gao, Qun Li, Guobin Wu, Ling Shao
分類: cs.AI, cs.CV, cs.RO
原文アブストラクト
World models and video generation are pivotal technologies in the domain of autonomous driving, each playing a critical role in enhancing the robustness and reliability of autonomous systems. World models, which simulate the dynamics of real-world environments, and video generation models, which produce realistic video sequences, are increasingly being integrated to improve situational awareness and decision-making capabilities in autonomous vehicles. This paper investigates the relationship between these two technologies, focusing on how their structural parallels, particularly in diffusion-based models, contribute to more accurate and coherent simulations of driving scenarios. We examine leading works such as JEPA, Genie, and Sora, which exemplify different approaches to world model design, thereby highlighting the lack of a universally accepted definition of world models. These diverse interpretations underscore the field's evolving understanding of how world models can be optimized for various autonomous driving tasks. Furthermore, this paper discusses the key evaluation metrics employed in this domain, such as Chamfer distance for 3D scene reconstruction and Fr\'echet Inception Distance (FID) for assessing the quality of generated video content. By analyzing the interplay between video generation and world models, this survey identifies critical challenges and future research directions, emphasizing the potential of these technologies to jointly advance the performance of autonomous driving systems. The findings presented in this paper aim to provide a comprehensive understanding of how the integration of video generation and world models can drive innovation in the development of safer and more reliable autonomous vehicles.
関連論文
- OccWAM: シーンから自己へのフローマッチングを統合した占有ワールドアクションモデル自動運転/世界モデル
- DriveWLA:自動運転のための世界・言語・行動モデリングによる未来動態とシーン意味論の統合自動運転/世界モデル
- PhysWAM: 自動運転のための物理的に整合した世界行動モデル自動運転/世界モデル
- 自動運転のシーン予測のための拡散トランスフォーマーワールドアクションモデル自動運転/世界モデル
- Discrete-WAM: 世界モデルとポリシー学習のための統一離散ビジョン・アクショントークン編集自動運転/世界モデル
- VectorWorld: ベクトルグラフ上の拡散フローによる効率的なストリーミング世界モデル自動運転/世界モデル
