マルチモーダル対話による基本動作の学習
Multimodal Interactive Learning of Primitive Actions
人間の実演と自然言語による対話を組み合わせ、少ないサンプルで計算エージェントに基本動作を教える枠組みを提案した研究。
著者: Tuan Do, Nikhil Krishnaswamy, Kyeongmin Rim, James Pustejovsky
分類: cs.RO
原文アブストラクト
We describe an ongoing project in learning to perform primitive actions from demonstrations using an interactive interface. In our previous work, we have used demonstrations captured from humans performing actions as training samples for a neural network-based trajectory model of actions to be performed by a computational agent in novel setups. We found that our original framework had some limitations that we hope to overcome by incorporating communication between the human and the computational agent, using the interaction between them to fine-tune the model learned by the machine. We propose a framework that uses multimodal human-computer interaction to teach action concepts to machines, making use of both live demonstration and communication through natural language, as two distinct teaching modalities, while requiring few training samples.
