形状とテクスチャを複数色空間で統合したオープンエンドな細粒度3D物体分類
Open-Ended Fine-Grained 3D Object Categorization by Combining Shape and Texture Features in Multiple Colorspaces
形状とテクスチャ情報を複数の色空間で組み合わせたスケール・姿勢不変な深層転移学習表現を生成し、人間が学習ループに関与して新しい物体カテゴリを教示できるオープンエンドな3D物体認識手法を提案した。
著者: Nils Keunecke, S. Hamidreza Kasaei
分類: cs.CV, cs.RO
原文アブストラクト
As a consequence of an ever-increasing number of service robots, there is a growing demand for highly accurate real-time 3D object recognition. Considering the expansion of robot applications in more complex and dynamic environments,it is evident that it is not possible to pre-program all object categories and anticipate all exceptions in advance. Therefore, robots should have the functionality to learn about new object categories in an open-ended fashion while working in the environment.Towards this goal, we propose a deep transfer learning approach to generate a scale- and pose-invariant object representation by considering shape and texture information in multiple colorspaces. The obtained global object representation is then fed to an instance-based object category learning and recognition,where a non-expert human user exists in the learning loop and can interactively guide the process of experience acquisition by teaching new object categories, or by correcting insufficient or erroneous categories. In this work, shape information encodes the common patterns of all categories, while texture information is used to describes the appearance of each instance in detail.Multiple color space combinations and network architectures are evaluated to find the most descriptive system. Experimental results showed that the proposed network architecture out-performed the selected state-of-the-art approaches in terms of object classification accuracy and scalability. Furthermore, we performed a real robot experiment in the context of serve-a-beer scenario to show the real-time performance of the proposed approach.
関連論文
- LM-MCVT: 軽量マルチモーダル・マルチビュー畳み込みVision Transformerによる3D物体認識3D物体認識
- 動的に拡張可能なネットワークによるオープンエンド3D物体認識3D物体認識
- オープンエンド3D物体認識における形状特徴・色恒常性・色空間・類似度尺度の重要性の検証3D物体認識
- より深く見てより良く認識する:オープンエンド3D物体認識のための共有トピックとカテゴリ固有辞書の学習3D物体認識
- OrthographicNet:オープンエンド領域における3D物体認識のための深層転移学習手法3D物体認識
- 単一RGB-D画像からの複数物体インスタンスを用いた教師なし3D物体発見とモデリング3D物体認識
