自動運転のためのスケーラブルな視覚ベース3D物体検出と単眼深度推定
Scalable Vision-Based 3D Object Detection and Monocular Depth Estimation for Autonomous Driving
単眼・ステレオ3D物体検出の精度と効率を幾何学的事前知識と相互活用で改善し、2D/3Dラベル混在学習や教師なし深度推定により実運用向けの視覚ベース3D知覚を実現した研究。
著者: Yuxuan Liu
分類: cs.CV, cs.RO
原文アブストラクト
This dissertation is a multifaceted contribution to the advancement of vision-based 3D perception technologies. In the first segment, the thesis introduces structural enhancements to both monocular and stereo 3D object detection algorithms. By integrating ground-referenced geometric priors into monocular detection models, this research achieves unparalleled accuracy in benchmark evaluations for monocular 3D detection. Concurrently, the work refines stereo 3D detection paradigms by incorporating insights and inferential structures gleaned from monocular networks, thereby augmenting the operational efficiency of stereo detection systems. The second segment is devoted to data-driven strategies and their real-world applications in 3D vision detection. A novel training regimen is introduced that amalgamates datasets annotated with either 2D or 3D labels. This approach not only augments the detection models through the utilization of a substantially expanded dataset but also facilitates economical model deployment in real-world scenarios where only 2D annotations are readily available. Lastly, the dissertation presents an innovative pipeline tailored for unsupervised depth estimation in autonomous driving contexts. Extensive empirical analyses affirm the robustness and efficacy of this newly proposed pipeline. Collectively, these contributions lay a robust foundation for the widespread adoption of vision-based 3D perception technologies in autonomous driving applications.
