MoreFusion: ボリュメトリックフュージョンによる複数物体の6D姿勢推定
MoreFusion: Multi-object Reasoning for 6D Pose Estimation from Volumetric Fusion
複数視点のRGB-D画像から物体の姿勢候補を蓄積し、接触・遮蔽のある複数物体の干渉しない6D姿勢を統合最適化で推定するシステムを提案。ロボットアームが物体の山を崩さずに取り出す実機応用も示した。
著者: Kentaro Wada, Edgar Sucar, Stephen James, Daniel Lenton, Andrew J. Davison
分類: cs.CV, cs.RO
原文アブストラクト
Robots and other smart devices need efficient object-based scene representations from their on-board vision systems to reason about contact, physics and occlusion. Recognized precise object models will play an important role alongside non-parametric reconstructions of unrecognized structures. We present a system which can estimate the accurate poses of multiple known objects in contact and occlusion from real-time, embodied multi-view vision. Our approach makes 3D object pose proposals from single RGB-D views, accumulates pose estimates and non-parametric occupancy information from multiple views as the camera moves, and performs joint optimization to estimate consistent, non-intersecting poses for multiple objects in contact. We verify the accuracy and robustness of our approach experimentally on 2 object datasets: YCB-Video, and our own challenging Cluttered YCB-Video. We demonstrate a real-time robotics application where a robot arm precisely and orderly disassembles complicated piles of objects, using only on-board RGB-D vision.
