日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

自動運転/マルチモーダルarXiv:2009.08876

自動運転のためのマルチモーダル専門家ネットワーク

Multi-modal Experts Network for Autonomous Driving

シェア:XThreadsFacebookLINEはてブBluesky

複数センサ入力の計算コスト増大と単純入力への過適合を、ゲーティング機構で各時点に最適な入力を選ぶマルチモーダル専門家ネットワークと多段階学習で解決し、3カメラとLiDAR搭載の1/6スケールトラックで実証した。

著者: Shihong Fang, Anna Choromanska

分類: cs.RO, cs.CV, cs.LG

原文アブストラクト

End-to-end learning from sensory data has shown promising results in autonomous driving. While employing many sensors enhances world perception and should lead to more robust and reliable behavior of autonomous vehicles, it is challenging to train and deploy such network and at least two problems are encountered in the considered setting. The first one is the increase of computational complexity with the number of sensing devices. The other is the phenomena of network overfitting to the simplest and most informative input. We address both challenges with a novel, carefully tailored multi-modal experts network architecture and propose a multi-stage training procedure. The network contains a gating mechanism, which selects the most relevant input at each inference time step using a mixed discrete-continuous policy. We demonstrate the plausibility of the proposed approach on our 1/6 scale truck equipped with three cameras and one LiDAR.

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI