日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

深度推定arXiv:2006.08903

突いて学ぶ深度推定:自己教師あり把持からの深度学習

Depth by Poking: Learning to Estimate Depth from Self-Supervised Grasping

シェア:XThreadsFacebookLINEはてブBluesky

ロボットが把持や突き動作をした際のエンドエフェクタ位置を順運動学でラベル化し、RGB-D画像から深度を推定するニューラルネットを自己教師ありで学習する手法を提案した。反射・透明面を含む乱雑な産業用ビンデータで従来の構造化光センサや教師なし学習より高精度を達成した。

著者: Ben Goodrich, Alex Kuefler, William D. Richards

分類: cs.CV, cs.LG, cs.RO, eess.IV

原文アブストラクト

Accurate depth estimation remains an open problem for robotic manipulation; even state of the art techniques including structured light and LiDAR sensors fail on reflective or transparent surfaces. We address this problem by training a neural network model to estimate depth from RGB-D images, using labels from physical interactions between a robot and its environment. Our network predicts, for each pixel in an input image, the z position that a robot's end effector would reach if it attempted to grasp or poke at the corresponding position. Given an autonomous grasping policy, our approach is self-supervised as end effector position labels can be recovered through forward kinematics, without human annotation. Although gathering such physical interaction data is expensive, it is necessary for training and routine operation of state of the art manipulation systems. Therefore, this depth estimator comes ``for free'' while collecting data for other tasks (e.g., grasping, pushing, placing). We show our approach achieves significantly lower root mean squared error than traditional structured light sensors and unsupervised deep learning methods on difficult, industry-scale jumbled bin datasets.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  3. 3newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI