RS2AD: 路側センサ観測から車載LiDARデータを生成するエンドツーエンド自動運転データ合成フレームワーク
RS2AD: End-to-End Autonomous Driving Data Generation from Roadside Sensor Observations
路側センサのLiDAR点群から対象車両の相対姿勢を用いて車載LiDAR座標系に変換し、仮想LiDARモデリングと点群分類・再サンプリングにより高忠実な車載LiDARデータを合成する手法を提案。KITTIに補完して学習に用いることで3D物体検出精度とデータ生成効率が向上することを示した。
著者: Ruidan Xing, Runyi Huang, Qing Xu, Lei He
分類: cs.RO, cs.CV
原文アブストラクト
End-to-end autonomous driving solutions, which process multi-modal sensory data to directly generate refined control commands, have become a dominant paradigm in autonomous driving research. However, these approaches predominantly depend on single-vehicle data collection for model training and optimization, resulting in significant challenges such as high data acquisition and annotation costs, the scarcity of critical driving scenarios, and fragmented datasets that impede model generalization. To mitigate these limitations, we introduce RS2AD, a novel framework for reconstructing and synthesizing vehicle-mounted LiDAR data from roadside sensor observations. Specifically, our method transforms roadside LiDAR point clouds into the vehicle-mounted LiDAR coordinate system by leveraging the target vehicle's relative pose. Subsequently, high-fidelity vehicle-mounted LiDAR data is synthesized through virtual LiDAR modeling, point cloud classification, and resampling techniques. To the best of our knowledge, this is the first approach to reconstruct vehicle-mounted LiDAR data from roadside sensor inputs. Extensive experimental evaluations demonstrate that incorporating the data generated by the RS2AD method (the RS2V-L dataset) into model training as a supplement to the KITTI dataset can significantly enhance the accuracy of 3D object detection and greatly improve the efficiency of end-to-end autonomous driving data generation. These findings strongly validate the effectiveness of the proposed method and underscore its potential in reducing dependence on costly vehicle-mounted data collection while improving the robustness of autonomous driving models.
