BURCHAKコーパス:視覚接地語彙の対話学習のためのチャレンジデータセット
The BURCHAK corpus: a Challenge Data Set for Interactive Learning of Visually Grounded Word Meanings
チューターが学習者に造語の視覚属性語を教える人間同士の対話データセットを新規収集し、n-gramによるチューター模擬と強化学習対話制御の評価を行った論文。
著者: Yanchao Yu, Arash Eshghi, Gregory Mills, Oliver Joseph Lemon
分類: cs.CL, cs.AI, cs.LG, cs.RO
原文アブストラクト
We motivate and describe a new freely available human-human dialogue dataset for interactive learning of visually grounded word meanings through ostensive definition by a tutor to a learner. The data has been collected using a novel, character-by-character variant of the DiET chat tool (Healey et al., 2003; Mills and Healey, submitted) with a novel task, where a Learner needs to learn invented visual attribute words (such as " burchak " for square) from a tutor. As such, the text-based interactions closely resemble face-to-face conversation and thus contain many of the linguistic phenomena encountered in natural, spontaneous dialogue. These include self-and other-correction, mid-sentence continuations, interruptions, overlaps, fillers, and hedges. We also present a generic n-gram framework for building user (i.e. tutor) simulations from this type of incremental data, which is freely available to researchers. We show that the simulations produce outputs that are similar to the original data (e.g. 78% turn match similarity). Finally, we train and evaluate a Reinforcement Learning dialogue control agent for learning visually grounded word meanings, trained from the BURCHAK corpus. The learned policy shows comparable performance to a rule-based system built previously.
