形状と材料の推論による道具代替:デュアルニューラルネットワークの活用
Tool Substitution with Shape and Material Reasoning Using Dual Neural Networks
視覚と分光の二つのニューラルネットワークで形状と材料を同時に推論し、与えられた候補からタスクに適した代替道具をランキングする手法を提案した。
著者: Nithin Shrivatsav, Lakshmi Nair, Sonia Chernova
分類: cs.RO, cs.LG
原文アブストラクト
This paper explores the problem of tool substitution, namely, identifying substitute tools for performing a task from a given set of candidate tools. We introduce a novel approach to tool substitution, that unlike prior work in the area, combines both shape and material reasoning to effectively identify substitute tools. Our approach combines the use of visual and spectral reasoning using dual neural networks. It takes as input, the desired action to be performed, and outputs a ranking of the available candidate tools based on their suitability for performing the action. Our results on a test set of 30 real-world objects show that our approach is able to effectively match shape and material similarities, with improved tool substitution performance when combining both.
