自動運転向けリアルなLiDARシミュレーションのための統合生成フレームワーク
A Unified Generative Framework for Realistic Lidar Simulation in Autonomous Driving Systems
LiDAR点群を深度・反射率画像に無損失変換し、新規の制御可能な生成モデルCoLiGenで画像変換することで、リアルなLiDARシミュレーションを実現する統合生成フレームワークを提案した論文。
著者: Hamed Haghighi, Mehrdad Dianati, Valentina Donzella, Kurt Debattista
分類: cs.CV, cs.LG, cs.RO, eess.IV
原文アブストラクト
Simulation models for perception sensors are integral components of automotive simulators used for the virtual Verification and Validation (V\&V) of Autonomous Driving Systems (ADS). These models also serve as powerful tools for generating synthetic datasets to train deep learning-based perception models. Lidar is a widely used sensor type among the perception sensors for ADS due to its high precision in 3D environment scanning. However, developing realistic Lidar simulation models is a significant technical challenge. In particular, unrealistic models can result in a large gap between the synthesised and real-world point clouds, limiting their effectiveness in ADS applications. Recently, deep generative models have emerged as promising solutions to synthesise realistic sensory data. However, for Lidar simulation, deep generative models have been primarily hybridised with conventional algorithms, leaving unified generative approaches largely unexplored in the literature. Motivated by this research gap, we propose a unified generative framework to enhance Lidar simulation fidelity. Our proposed framework projects Lidar point clouds into depth-reflectance images via a lossless transformation, and employs our novel Controllable Lidar point cloud Generative model, CoLiGen, to translate the images. We extensively evaluate our CoLiGen model, comparing it with the state-of-the-art image-to-image translation models using various metrics to assess the realness, faithfulness, and performance of a downstream perception model. Our results show that CoLiGen exhibits superior performance across most metrics. The dataset and source code for this research are available at https://github.com/hamedhaghighi/CoLiGen.git.
関連論文
- LidarVerse:タスクとセンサを横断するリアルタイム統合LiDARワールドモデルLiDARシミュレーション
- 悪天候下での自動運転向け現実的LiDARデータシミュレーション:物理情報学習アプローチLiDARシミュレーション
- 自動車用LiDARの物理ベースシミュレーションLiDARシミュレーション
- 物理ベースのニューラルLiDAR再シミュレーションLiDARシミュレーション
- PCGen: LiDARシミュレーションのための点群生成器LiDARシミュレーション
- AdaSplats: 適応的スプラッティングによる高精度3Dモデリングとリアルタイム高忠実LiDARシミュレーションLiDARシミュレーション
