GANベース分類による操作指示の接地言語理解
Grounded Language Understanding for Manipulation Instructions Using GAN-Based Classification
家庭用サービスロボット向けに、動詞が欠けた短い指示文から適切な物体を推定するGANベースの分類手法を提案し、Visual QAデータセットを基にした評価でベースラインを上回る性能を示した。
著者: Komei Sugiura, Hisashi Kawai
分類: cs.RO, cs.CL, cs.HC
原文アブストラクト
The target task of this study is grounded language understanding for domestic service robots (DSRs). In particular, we focus on instruction understanding for short sentences where verbs are missing. This task is of critical importance to build communicative DSRs because manipulation is essential for DSRs. Existing instruction understanding methods usually estimate missing information only from non-grounded knowledge; therefore, whether the predicted action is physically executable or not was unclear. In this paper, we present a grounded instruction understanding method to estimate appropriate objects given an instruction and situation. We extend the Generative Adversarial Nets (GAN) and build a GAN-based classifier using latent representations. To quantitatively evaluate the proposed method, we have developed a data set based on the standard data set used for Visual QA. Experimental results have shown that the proposed method gives the better result than baseline methods.
