LiDARをカメラとして用いたEnd-to-End自動運転
LiDAR-as-Camera for End-to-End Driving
Ouster LiDARのサラウンドビュー画像を入力に使い、実車の道路追従タスクでカメラベースモデルと同等以上の性能を示し、悪天候への汎化で優位性を確認した。
著者: Ardi Tampuu, Romet Aidla, Jan Are van Gent, Tambet Matiisen
分類: cs.AI, cs.CV, cs.RO
原文アブストラクト
The core task of any autonomous driving system is to transform sensory inputs into driving commands. In end-to-end driving, this is achieved via a neural network, with one or multiple cameras as the most commonly used input and low-level driving command, e.g. steering angle, as output. However, depth-sensing has been shown in simulation to make the end-to-end driving task easier. On a real car, combining depth and visual information can be challenging, due to the difficulty of obtaining good spatial and temporal alignment of the sensors. To alleviate alignment problems, Ouster LiDARs can output surround-view LiDAR-images with depth, intensity, and ambient radiation channels. These measurements originate from the same sensor, rendering them perfectly aligned in time and space. We demonstrate that such LiDAR-images are sufficient for the real-car road-following task and perform at least equally to camera-based models in the tested conditions, with the difference increasing when needing to generalize to new weather conditions. In the second direction of study, we reveal that the temporal smoothness of off-policy prediction sequences correlates equally well with actual on-policy driving ability as the commonly used mean absolute error.
関連論文
- 蒸留サロゲートで安全クリティカルなシーンを生成し堅牢なEnd-to-End自動運転を実現End-to-End自動運転
- SC-IMMベースの教師信号によるEnd-to-End自動運転の軌道出力安定化End-to-End自動運転
- 語彙候補と拡散によるシーン適応的洗練を統合したEnd-to-End自動運転End-to-End自動運転
- 見るものを減らして運転を改善:基盤モデルの確率的パッチ選択による汎化可能なEnd-to-End自動運転End-to-End自動運転
- Raw2Drive: 世界モデル整合による強化学習ベースのEnd-to-End自動運転End-to-End自動運転
- EgoFSD: 不確実性デノイジングと反復的洗練による効率的なEnd-to-End自動運転のための自己中心的全スパースパラダイムEnd-to-End自動運転
