日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

自動運転arXiv:2407.02878

効率的な融合とタスク誘導埋め込みによるエンドツーエンド自動運転

Efficient Fusion and Task Guided Embedding for End-to-end Autonomous Driving

シェア:XThreadsFacebookLINEはてブBluesky

EfficientViTとクロスアテンション、デコーダのみのTransformerを組み合わせ、タスク誘導の埋め込みでセンサー融合とリスク予測を行う軽量な自動運転モデルEfficientFuserを提案。CARLAで最先端軽量手法より37.6%のパラメータと8.7%の計算量で運転スコアは0.4%低いのみ。

著者: Yipin Guo, Yilin Lang, Qinyuan Ren

分類: cs.RO, cs.AI

原文アブストラクト

To address the challenges of sensor fusion and safety risk prediction, contemporary closed-loop autonomous driving neural networks leveraging imitation learning typically require a substantial volume of parameters and computational resources to run neural networks. Given the constrained computational capacities of onboard vehicular computers, we introduce a compact yet potent solution named EfficientFuser. This approach employs EfficientViT for visual information extraction and integrates feature maps via cross attention. Subsequently, it utilizes a decoder-only transformer for the amalgamation of multiple features. For prediction purposes, learnable vectors are embedded as tokens to probe the association between the task and sensor features through attention. Evaluated on the CARLA simulation platform, EfficientFuser demonstrates remarkable efficiency, utilizing merely 37.6% of the parameters and 8.7% of the computations compared to the state-of-the-art lightweight method with only 0.4% lower driving score, and the safety score neared that of the leading safety-enhanced method, showcasing its efficacy and potential for practical deployment in autonomous driving systems.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

OZ GAMING(GPU搭載BTOゲーミングPC)

OZ GAMING(GPU搭載BTOゲーミングPC)の公式広告バナーOZ GAMINGで完成品PCを見る ↗
PR本紙発行元 EmplifAI