布操作タスクにおける意味的状態推定
Semantic State Estimation in Cloth Manipulation Tasks
布の操作中の意味的状態(しわ寄せ・斜め折りなど)を推定するため、大規模なRGB画像データセットを構築し、深層ネットワークのベースラインを評価した研究。
著者: Georgies Tzelepis, Eren Erdal Aksoy, Júlia Borràs, Guillem Alenyà
分類: cs.RO, cs.CV
原文アブストラクト
Understanding of deformable object manipulations such as textiles is a challenge due to the complexity and high dimensionality of the problem. Particularly, the lack of a generic representation of semantic states (e.g., \textit{crumpled}, \textit{diagonally folded}) during a continuous manipulation process introduces an obstacle to identify the manipulation type. In this paper, we aim to solve the problem of semantic state estimation in cloth manipulation tasks. For this purpose, we introduce a new large-scale fully-annotated RGB image dataset showing various human demonstrations of different complicated cloth manipulations. We provide a set of baseline deep networks and benchmark them on the problem of semantic state estimation using our proposed dataset. Furthermore, we investigate the scalability of our semantic state estimation framework in robot monitoring tasks of long and complex cloth manipulations.
