PCGen: LiDARシミュレーションのための点群生成器
PCGen: Point Cloud Generator for LiDAR Simulation
LiDAR知覚システム向けに、実データのノイズや欠落を再現するFPAレイキャスティングとraydropサロゲートモデルを提案し、歩行者などの変形可能なVRUのシミュレーションも可能にした点群生成手法。
著者: Chenqi Li, Yuan Ren, Bingbing Liu
分類: cs.RO, cs.AI
原文アブストラクト
Data is a fundamental building block for LiDAR perception systems. Unfortunately, real-world data collection and annotation is extremely costly & laborious. Recently, real data based LiDAR simulators have shown tremendous potential to complement real data, due to their scalability and high-fidelity compared to graphics engine based methods. Before simulation can be deployed in the real-world, two shortcomings need to be addressed. First, existing methods usually generate data which are more noisy and complete than the real point clouds, due to 3D reconstruction error and pure geometry-based raycasting method. Second, prior works on simulation for object detection focus solely on rigid objects, like cars, but VRUs, like pedestrians, are important road participants. To tackle the first challenge, we propose FPA raycasting and surrogate model raydrop. FPA enables the simulation of both point cloud coordinates and sensor features, while taking into account reconstruction noise. The ray-wise surrogate raydrop model mimics the physical properties of LiDAR's laser receiver to determine whether a simulated point would be recorded by a real LiDAR. With minimal training data, the surrogate model can generalize to different geographies and scenes, closing the domain gap between raycasted and real point clouds. To tackle the simulation of deformable VRU simulation, we employ SMPL dataset to provide a pedestrian simulation baseline and compare the domain gap between CAD and reconstructed objects. Applying our pipeline to perform novel sensor synthesis, results show that object detection models trained by simulation data can achieve similar result as the real data trained model.
関連論文
- LidarVerse:タスクとセンサを横断するリアルタイム統合LiDARワールドモデルLiDARシミュレーション
- 悪天候下での自動運転向け現実的LiDARデータシミュレーション:物理情報学習アプローチLiDARシミュレーション
- 自動車用LiDARの物理ベースシミュレーションLiDARシミュレーション
- 物理ベースのニューラルLiDAR再シミュレーションLiDARシミュレーション
- 自動運転向けリアルなLiDARシミュレーションのための統合生成フレームワークLiDARシミュレーション
- AdaSplats: 適応的スプラッティングによる高精度3Dモデリングとリアルタイム高忠実LiDARシミュレーションLiDARシミュレーション
