RoCap: 外観変化物体の姿勢推定のためのロボットデータ収集パイプライン
RoCap: A Robotic Data Collection Pipeline for the Pose Estimation of Appearance-Changing Objects
ロボットアームで対象物体を様々な6D姿勢で動かし、関節角度から正解姿勢を自動計算して学習データを収集するパイプラインを提案。ぬいぐるみや透明・反射・関節物体など外観が変化する物体の姿勢推定モデルを効率的に訓練できる。
著者: Jiahao Nick Li, Toby Chong, Zhongyi Zhou, Hironori Yoshida, Koji Yatani, Xiang 'Anthony' Chen, Takeo Igarashi
分類: cs.RO, cs.HC
原文アブストラクト
Object pose estimation plays a vital role in mixed-reality interactions when users manipulate tangible objects as controllers. Traditional vision-based object pose estimation methods leverage 3D reconstruction to synthesize training data. However, these methods are designed for static objects with diffuse colors and do not work well for objects that change their appearance during manipulation, such as deformable objects like plush toys, transparent objects like chemical flasks, reflective objects like metal pitchers, and articulated objects like scissors. To address this limitation, we propose Rocap, a robotic pipeline that emulates human manipulation of target objects while generating data labeled with ground truth pose information. The user first gives the target object to a robotic arm, and the system captures many pictures of the object in various 6D configurations. The system trains a model by using captured images and their ground truth pose information automatically calculated from the joint angles of the robotic arm. We showcase pose estimation for appearance-changing objects by training simple deep-learning models using the collected data and comparing the results with a model trained with synthetic data based on 3D reconstruction via quantitative and qualitative evaluation. The findings underscore the promising capabilities of Rocap.
