日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

能動的視点選択arXiv:2303.03315

MACARONS: RGB画像のみの自己教師あり学習による環境マッピングとカバレッジ予測

MACARONS: Mapping And Coverage Anticipation with RGB Online Self-Supervision

シェア:XThreadsFacebookLINEはてブBluesky

カラー画像のみから自己教師あり学習で3D占有場を予測し、次の最適視点を推定する手法を提案。深度センサ不要で大規模環境の探索と再構成を実現。

著者: Antoine Guédon, Tom Monnier, Pascal Monasse, Vincent Lepetit

分類: cs.CV, cs.AI, cs.RO

原文アブストラクト

We introduce a method that simultaneously learns to explore new large environments and to reconstruct them in 3D from color images only. This is closely related to the Next Best View problem (NBV), where one has to identify where to move the camera next to improve the coverage of an unknown scene. However, most of the current NBV methods rely on depth sensors, need 3D supervision and/or do not scale to large scenes. Our method requires only a color camera and no 3D supervision. It simultaneously learns in a self-supervised fashion to predict a "volume occupancy field" from color images and, from this field, to predict the NBV. Thanks to this approach, our method performs well on new scenes as it is not biased towards any training 3D data. We demonstrate this on a recent dataset made of various 3D scenes and show it performs even better than recent methods requiring a depth sensor, which is not a realistic assumption for outdoor scenes captured with a flying drone.

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI