MORE: 多視点3D物体認識と姿勢推定の同時実行
MORE: Simultaneous Multi-View 3D Object Recognition and Pose Estimation
物体ごとに最適な視点をエントロピー推定で選び、その多視点画像から物体カテゴリと姿勢を同時に予測する手法を提案し、実機の飲み物提供タスクで有効性を示した。
著者: Tommaso Parisotto, Subhaditya Mukherjee, Hamidreza Kasaei
分類: cs.RO
原文アブストラクト
Simultaneous object recognition and pose estimation are two key functionalities for robots to safely interact with humans as well as environments. Although both object recognition and pose estimation use visual input, most state-of-the-art tackles them as two separate problems since the former needs a view-invariant representation while object pose estimation necessitates a view-dependent description. Nowadays, multi-view Convolutional Neural Network (MVCNN) approaches show state-of-the-art classification performance. Although MVCNN object recognition has been widely explored, there has been very little research on multi-view object pose estimation methods, and even less on addressing these two problems simultaneously. The pose of virtual cameras in MVCNN methods is often predefined in advance, leading to bound the application of such approaches. In this paper, we propose an approach capable of handling object recognition and pose estimation simultaneously. In particular, we develop a deep object-agnostic entropy estimation model, capable of predicting the best viewpoints of a given 3D object. The obtained views of the object are then fed to the network to simultaneously predict the pose and category label of the target object. Experimental results showed that the views obtained from such positions are descriptive enough to achieve a good accuracy score. Furthermore, we designed a real-life serve drink scenario to demonstrate how well the proposed approach worked in real robot tasks. Code is available online at: github.com/SubhadityaMukherjee/more_mvcnn
関連論文
- 動的マージン付きトリプレット損失による3D物体インスタンス認識と姿勢推定物体認識・姿勢推定
