自動運転車向け多段階・マルチモーダル特徴融合による高精度3D物体検出
Multi-level and multi-modal feature fusion for accurate 3D object detection in Connected and Automated Vehicles
LiDARとカメラの特徴を3段階で融合する新しいDNNモデルを提案し、KITTIベンチマークで遠距離・遮蔽物体の3D検出精度を向上させた。
著者: Yiming Hou, Mahdi Rezaei, Richard Romano
分類: cs.CV, cs.NE, cs.RO, eess.IV
原文アブストラクト
Aiming at highly accurate object detection for connected and automated vehicles (CAVs), this paper presents a Deep Neural Network based 3D object detection model that leverages a three-stage feature extractor by developing a novel LIDAR-Camera fusion scheme. The proposed feature extractor extracts high-level features from two input sensory modalities and recovers the important features discarded during the convolutional process. The novel fusion scheme effectively fuses features across sensory modalities and convolutional layers to find the best representative global features. The fused features are shared by a two-stage network: the region proposal network (RPN) and the detection head (DH). The RPN generates high-recall proposals, and the DH produces final detection results. The experimental results show the proposed model outperforms more recent research on the KITTI 2D and 3D detection benchmark, particularly for distant and highly occluded instances.
