学び方を学ぶ:視覚的接地語意を逐次学習する適応型対話エージェント
Learning how to learn: an adaptive dialogue agent for incrementally learning visually grounded word meanings
人間との対話を通じて物体の色や形などの視覚的意味を逐次学習する強化学習ベースの対話エージェントを提案し、模擬チューターとの実験で分類精度と教示コストのバランスが手作りルールより優れることを示した。
著者: Yanchao Yu, Arash Eshghi, Oliver Lemon
分類: cs.CL, cs.AI, cs.LG, cs.RO
原文アブストラクト
We present an optimised multi-modal dialogue agent for interactive learning of visually grounded word meanings from a human tutor, trained on real human-human tutoring data. Within a life-long interactive learning period, the agent, trained using Reinforcement Learning (RL), must be able to handle natural conversations with human users and achieve good learning performance (accuracy) while minimising human effort in the learning process. We train and evaluate this system in interaction with a simulated human tutor, which is built on the BURCHAK corpus -- a Human-Human Dialogue dataset for the visual learning task. The results show that: 1) The learned policy can coherently interact with the simulated user to achieve the goal of the task (i.e. learning visual attributes of objects, e.g. colour and shape); and 2) it finds a better trade-off between classifier accuracy and tutoring costs than hand-crafted rule-based policies, including ones with dynamic policies.
