自動運転向け汎用センサーフュージョンのスケーラブルなプリミティブ
Scalable Primitives for Generalized Sensor Fusion in Autonomous Vehicles
センサー入力とタスクをモジュール化した汎用センサーフュージョン(GSF)を提案し、高密度LiDARと低密度LiDAR+カメラの組み合わせが3D物体検出でほぼ同等の性能を持つことを示した。
著者: Sammy Sidhu, Linda Wang, Tayyab Naseer, Ashish Malhotra, Jay Chia, Aayush Ahuja, Ella Rasmussen, Qiangui Huang, Ray Gao
分類: cs.CV, cs.RO
原文アブストラクト
In autonomous driving, there has been an explosion in the use of deep neural networks for perception, prediction and planning tasks. As autonomous vehicles (AVs) move closer to production, multi-modal sensor inputs and heterogeneous vehicle fleets with different sets of sensor platforms are becoming increasingly common in the industry. However, neural network architectures typically target specific sensor platforms and are not robust to changes in input, making the problem of scaling and model deployment particularly difficult. Furthermore, most players still treat the problem of optimizing software and hardware as entirely independent problems. We propose a new end to end architecture, Generalized Sensor Fusion (GSF), which is designed in such a way that both sensor inputs and target tasks are modular and modifiable. This enables AV system designers to easily experiment with different sensor configurations and methods and opens up the ability to deploy on heterogeneous fleets using the same models that are shared across a large engineering organization. Using this system, we report experimental results where we demonstrate near-parity of an expensive high-density (HD) LiDAR sensor with a cheap low-density (LD) LiDAR plus camera setup in the 3D object detection task. This paves the way for the industry to jointly design hardware and software architectures as well as large fleets with heterogeneous configurations.
関連論文
- SDCM: 車載ネットワークにおけるレーダー・視覚3次元物体検出のための模擬稠密化と補償モデリング融合センサーフュージョン
- CaRLi-V: カメラ・レーダー・LiDAR融合による点単位3D速度推定センサーフュージョン
- カメラによる道路レイアウト抽出を活用したT字路でのmmWaveレーダーによる見通し外歩行者位置推定センサーフュージョン
- 不確かさ駆動型レーダー慣性融合による瞬時3次元自己速度推定センサーフュージョン
- 任意のLiDARをガイドとする拡散事前分布による教師なしレーダー点群強調センサーフュージョン
- 画像と4Dレーダースペクトルの深度認識融合による3D物体検出センサーフュージョン
