画像におけるアフォーダンスセグメンテーションのためのベイズ深層学習
Bayesian Deep Learning for Affordance Segmentation in images
Mask-RCNNにモンテカルロドロップアウトを導入し、アフォーダンスを確率的にセグメンテーションするベイズ深層ネットワークを提案。不確実性の空間分布を定量化し、決定論的ネットワークを上回る性能を達成した。
著者: Lorenzo Mur-Labadia, Ruben Martinez-Cantin, Jose J. Guerrero
分類: cs.CV, cs.AI, cs.LG, cs.RO
原文アブストラクト
Affordances are a fundamental concept in robotics since they relate available actions for an agent depending on its sensory-motor capabilities and the environment. We present a novel Bayesian deep network to detect affordances in images, at the same time that we quantify the distribution of the aleatoric and epistemic variance at the spatial level. We adapt the Mask-RCNN architecture to learn a probabilistic representation using Monte Carlo dropout. Our results outperform the state-of-the-art of deterministic networks. We attribute this improvement to a better probabilistic feature space representation on the encoder and the Bayesian variability induced at the mask generation, which adapts better to the object contours. We also introduce the new Probability-based Mask Quality measure that reveals the semantic and spatial differences on a probabilistic instance segmentation model. We modify the existing Probabilistic Detection Quality metric by comparing the binary masks rather than the predicted bounding boxes, achieving a finer-grained evaluation of the probabilistic segmentation. We find aleatoric variance in the contours of the objects due to the camera noise, while epistemic variance appears in visual challenging pixels.
関連論文
- アフォーダンス座標系による散乱環境下での操作指向物体認識アフォーダンス認識
- 物体アフォーダンス認識による操作タスクのシーン推論支援アフォーダンス認識
- 単一RGB画像からアフォーダンスを密に予測する学習手法アフォーダンス認識
