弱教師ありマスク蒸留による人間中心環境の文脈情報理解
Robots Understanding Contextual Information in Human-Centered Environments using Weakly Supervised Mask Data Distillation
物体分類や画像キャプション用のCNNを活用し、人手ラベルなしで疑似セグメンテーションラベルを自動生成するWeSuperMaDDを提案。看板や記号などの文脈情報をロボットが認識・探索に利用できるようにする。
著者: Daniel Dworakowski, Goldie Nejat
分類: cs.CV, cs.RO
原文アブストラクト
Contextual information in human environments, such as signs, symbols, and objects provide important information for robots to use for exploration and navigation. To identify and segment contextual information from complex images obtained in these environments, data-driven methods such as Convolutional Neural Networks (CNNs) are used. However, these methods require large amounts of human labeled data which are slow and time-consuming to obtain. Weakly supervised methods address this limitation by generating pseudo segmentation labels (PSLs). In this paper, we present the novel Weakly Supervised Mask Data Distillation (WeSuperMaDD) architecture for autonomously generating PSLs using CNNs not specifically trained for the task of context segmentation; i.e., CNNs trained for object classification, image captioning, etc. WeSuperMaDD uniquely generates PSLs using learned image features from sparse and limited diversity data; common in robot navigation tasks in human-centred environments (malls, grocery stores). Our proposed architecture uses a new mask refinement system which automatically searches for the PSL with the fewest foreground pixels that satisfies cost constraints. This removes the need for handcrafted heuristic rules. Extensive experiments successfully validated the performance of WeSuperMaDD in generating PSLs for datasets with text of various scales, fonts, and perspectives in multiple indoor/outdoor environments. A comparison with Naive, GrabCut, and Pyramid methods found a significant improvement in label and segmentation quality. Moreover, a context segmentation CNN trained using the WeSuperMaDD architecture achieved measurable improvements in accuracy compared to one trained with Naive PSLs. Our method also had comparable performance to existing state-of-the-art text detection and segmentation methods on real datasets without requiring segmentation labels for training.
関連論文
- 画像ラベルだけで粗い海草セグメンテーションを実現弱教師ありセグメンテーション
