日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

深度推定arXiv:1904.04998

未知カメラの動画から教師なしで単眼深度を学習する手法

Depth from Videos in the Wild: Unsupervised Monocular Depth Learning from Unknown Cameras

シェア:XThreadsFacebookLINEはてブBluesky

単眼動画のフレーム間整合性のみを教師信号に、深度・自己運動・物体運動・カメラ内部パラメータ(レンズ歪み含む)を同時に教師なし学習する手法を提案し、CityscapesやKITTIで深度予測とオドメトリの新たな最先端を達成した。

著者: Ariel Gordon, Hanhan Li, Rico Jonschkowski, Anelia Angelova

分類: cs.CV, cs.GR, cs.LG, cs.RO

原文アブストラクト

We present a novel method for simultaneous learning of depth, egomotion, object motion, and camera intrinsics from monocular videos, using only consistency across neighboring video frames as supervision signal. Similarly to prior work, our method learns by applying differentiable warping to frames and comparing the result to adjacent ones, but it provides several improvements: We address occlusions geometrically and differentiably, directly using the depth maps as predicted during training. We introduce randomized layer normalization, a novel powerful regularizer, and we account for object motion relative to the scene. To the best of our knowledge, our work is the first to learn the camera intrinsic parameters, including lens distortion, from video in an unsupervised manner, thereby allowing us to extract accurate depth and motion from arbitrary videos of unknown origin at scale. We evaluate our results on the Cityscapes, KITTI and EuRoC datasets, establishing new state of the art on depth prediction and odometry, and demonstrate qualitatively that depth prediction can be learned from a collection of YouTube videos.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  3. 3newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI