セマンティック深度クラウドとマルチエージェントを用いたEnd-to-End自動運転
End-to-end Autonomous Driving with Semantic Depth Cloud Mapping and Multi-agent
RGBDカメラからセマンティック深度クラウド地図と交通情報を推定し、GPS・速度情報と合わせてマルチエージェントで操舵・スロットル・ブレーキを決定するEnd-to-End自動運転モデルを提案し、CARLAで評価した。
著者: Oskar Natan, Jun Miura
分類: cs.RO, cs.AI, cs.CV
原文アブストラクト
Focusing on the task of point-to-point navigation for an autonomous driving vehicle, we propose a novel deep learning model trained with end-to-end and multi-task learning manners to perform both perception and control tasks simultaneously. The model is used to drive the ego vehicle safely by following a sequence of routes defined by the global planner. The perception part of the model is used to encode high-dimensional observation data provided by an RGBD camera while performing semantic segmentation, semantic depth cloud (SDC) mapping, and traffic light state and stop sign prediction. Then, the control part decodes the encoded features along with additional information provided by GPS and speedometer to predict waypoints that come with a latent feature space. Furthermore, two agents are employed to process these outputs and make a control policy that determines the level of steering, throttle, and brake as the final action. The model is evaluated on CARLA simulator with various scenarios made of normal-adversarial situations and different weathers to mimic real-world conditions. In addition, we do a comparative study with some recent models to justify the performance in multiple aspects of driving. Moreover, we also conduct an ablation study on SDC mapping and multi-agent to understand their roles and behavior. As a result, our model achieves the highest driving score even with fewer parameters and computation load. To support future studies, we share our codes at https://github.com/oskarnatan/end-to-end-driving.
関連論文
- 蒸留サロゲートで安全クリティカルなシーンを生成し堅牢なEnd-to-End自動運転を実現End-to-End自動運転
- SC-IMMベースの教師信号によるEnd-to-End自動運転の軌道出力安定化End-to-End自動運転
- 語彙候補と拡散によるシーン適応的洗練を統合したEnd-to-End自動運転End-to-End自動運転
- 見るものを減らして運転を改善:基盤モデルの確率的パッチ選択による汎化可能なEnd-to-End自動運転End-to-End自動運転
- Raw2Drive: 世界モデル整合による強化学習ベースのEnd-to-End自動運転End-to-End自動運転
- EgoFSD: 不確実性デノイジングと反復的洗練による効率的なEnd-to-End自動運転のための自己中心的全スパースパラダイムEnd-to-End自動運転
