自動運転LiDAR物体検出のためのJoint Embedding Predictive Architectureによる自己教師あり表現学習
Self-Supervised Representation Learning with Joint Embedding Predictive Architecture for Automotive LiDAR Object Detection
LiDAR点群の自己教師あり事前学習にJEPAを初適用し、BEV埋め込み予測と分散正則化で表現崩壊を防ぎ、KITTI3D・Waymo・ONCEで検出精度を向上させた。
著者: Haoran Zhu, Zhenyuan Dong, Kristi Topollai, Beiyao Sha, Anna Choromanska
分類: cs.RO, cs.CV
原文アブストラクト
Recently, self-supervised representation learning relying on vast amounts of unlabeled data has been explored as a pre-training method for autonomous driving. However, directly applying popular contrastive or generative methods to this problem is insufficient and may even lead to negative transfer. In this paper, we present AD-L-JEPA, a novel self-supervised pre-training framework with a joint embedding predictive architecture (JEPA) for automotive LiDAR object detection. Unlike existing methods, AD-L-JEPA is neither generative nor contrastive. Instead of explicitly generating masked regions, our method predicts Bird's-Eye-View embeddings to capture the diverse nature of driving scenes. Furthermore, our approach eliminates the need to manually form contrastive pairs by employing explicit variance regularization to avoid representation collapse. Experimental results demonstrate consistent improvements on the LiDAR 3D object detection downstream task across the KITTI3D, Waymo, and ONCE datasets, while reducing GPU hours by 1.9x-2.7x and GPU memory by 2.8x-4x compared with the state-of-the-art method Occupancy-MAE. Notably, on the largest ONCE dataset, pre-training on 100K frames yields a 1.61 mAP gain, better than all other methods pre-trained on either 100K or 500K frames, and pre-training on 500K frames yields a 2.98 mAP gain, better than all other methods pre-trained on either 500K or 1M frames. AD-L-JEPA constitutes the first JEPA-based pre-training method for autonomous driving. It offers better quality, faster, and more GPU-memory-efficient self-supervised representation learning. The source code of AD-L-JEPA is ready to be released.
関連論文
- 雪の向こう側:LiDAR物体検出における気象効果と交絡メタ因子の分離LiDAR物体検出
- 悪天候下のLiDAR物体検出を時系列オフセットで強化する手法LiDAR物体検出
- TimePillars: 時間的再帰型3D LiDAR物体検出LiDAR物体検出
- LiDAR点群処理の投影法比較:幾何ベースと深層学習ベースの物体検出LiDAR物体検出
- 高解像度LiDARのラベル付きデータで低解像度センサ向け高速物体検出器を訓練する手法LiDAR物体検出
