単一RGB画像からアフォーダンスを密に予測する学習手法
Learning to Label Affordances from Simulated and Real Data
1枚のRGB画像から物体や部位のアフォーダンスを画素単位で予測するResNetベースの手法を提案し、シミュレーションと実データで15種類のアフォーダンスを評価した。
著者: Timo Lüddecke, Florentin Wörgötter
分類: cs.CV, cs.RO
原文アブストラクト
An autonomous robot should be able to evaluate the affordances that are offered by a given situation. Here we address this problem by designing a system that can densely predict affordances given only a single 2D RGB image. This is achieved with a convolutional neural network (ResNet), which we combine with refinement modules recently proposed for addressing semantic image segmentation. We define a novel cost function, which is able to handle (potentially multiple) affordances of objects and their parts in a pixel-wise manner even in the case of incomplete data. We perform qualitative as well as quantitative evaluations with simulated and real data assessing 15 different affordances. In general, we find that affordances, which are well-enough represented in the training data, are correctly recognized with a substantial fraction of correctly assigned pixels. Furthermore, we show that our model outperforms several baselines. Hence, this method can give clear action guidelines for a robot.
関連論文
- 画像におけるアフォーダンスセグメンテーションのためのベイズ深層学習アフォーダンス認識
- アフォーダンス座標系による散乱環境下での操作指向物体認識アフォーダンス認識
- 物体アフォーダンス認識による操作タスクのシーン推論支援アフォーダンス認識
