日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

3D検出arXiv:2001.03343

RTM3D: 物体キーポイントからのリアルタイム単眼3D検出

RTM3D: Real-time Monocular 3D Detection from Object Keypoints for Autonomous Driving

シェア:XThreadsFacebookLINEはてブBluesky

3Dバウンディングボックスの9つの透視キーポイントを画像空間で予測し、3D-2Dの幾何関係から寸法・位置・姿勢を復元する単眼3D検出のリアルタイム手法を提案。KITTIで最先端性能を達成。

著者: Peixuan Li, Huaici Zhao, Pengfei Liu, Feidao Cao

分類: cs.CV, cs.RO, eess.IV

原文アブストラクト

In this work, we propose an efficient and accurate monocular 3D detection framework in single shot. Most successful 3D detectors take the projection constraint from the 3D bounding box to the 2D box as an important component. Four edges of a 2D box provide only four constraints and the performance deteriorates dramatically with the small error of the 2D detector. Different from these approaches, our method predicts the nine perspective keypoints of a 3D bounding box in image space, and then utilize the geometric relationship of 3D and 2D perspectives to recover the dimension, location, and orientation in 3D space. In this method, the properties of the object can be predicted stably even when the estimation of keypoints is very noisy, which enables us to obtain fast detection speed with a small architecture. Training our method only uses the 3D properties of the object without the need for external networks or supervision data. Our method is the first real-time system for monocular image 3D detection while achieves state-of-the-art performance on the KITTI benchmark. Code will be released at https://github.com/Banconxuan/RTM3D.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  3. 3newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI