空間エンコーディングによるセンサフュージョンを用いた自動運転
Sensor Fusion by Spatial Encoding for Autonomous Driving
カメラとLiDARのデータをTransformerで多解像度に融合し、自動運転の知覚性能を向上させる手法を提案した。
著者: Quoc-Vinh Lai-Dang, Jihui Lee, Bumgeun Park, Dongsoo Har
分類: cs.CV, cs.AI, cs.LG, cs.RO
原文アブストラクト
Sensor fusion is critical to perception systems for task domains such as autonomous driving and robotics. Recently, the Transformer integrated with CNN has demonstrated high performance in sensor fusion for various perception tasks. In this work, we introduce a method for fusing data from camera and LiDAR. By employing Transformer modules at multiple resolutions, proposed method effectively combines local and global contextual relationships. The performance of the proposed method is validated by extensive experiments with two adversarial benchmarks with lengthy routes and high-density traffics. The proposed method outperforms previous approaches with the most challenging benchmarks, achieving significantly higher driving and infraction scores. Compared with TransFuser, it achieves 8% and 19% improvement in driving scores for the Longest6 and Town05 Long benchmarks, respectively.
