マルチモーダルハイブリッド後期カスケード融合ネットワークによる3D物体検出の強化
A Multimodal Hybrid Late-Cascade Fusion Network for Enhanced 3D Object Detection
LiDARとRGBカメラを組み合わせ、後期融合で誤検出を減らしカスケード融合で未検出を補う3D物体検出手法を提案。KITTIで歩行者や自転車の検出精度が向上。
著者: Carlo Sgaravatti, Roberto Basla, Riccardo Pieroni, Matteo Corno, Sergio M. Savaresi, Luca Magri, Giacomo Boracchi
分類: cs.CV, cs.AI, cs.RO
原文アブストラクト
We present a new way to detect 3D objects from multimodal inputs, leveraging both LiDAR and RGB cameras in a hybrid late-cascade scheme, that combines an RGB detection network and a 3D LiDAR detector. We exploit late fusion principles to reduce LiDAR False Positives, matching LiDAR detections with RGB ones by projecting the LiDAR bounding boxes on the image. We rely on cascade fusion principles to recover LiDAR False Negatives leveraging epipolar constraints and frustums generated by RGB detections of separate views. Our solution can be plugged on top of any underlying single-modal detectors, enabling a flexible training process that can take advantage of pre-trained LiDAR and RGB detectors, or train the two branches separately. We evaluate our results on the KITTI object detection benchmark, showing significant performance improvements, especially for the detection of Pedestrians and Cyclists.
