ジェスチャー種別ライブラリを用いたソーシャルロボットのための深層ジェスチャー生成
Deep Gesture Generation for Social Robots Using Type-Specific Libraries
TEDデータセットに基づき単語を「イメージ的」「ビート」「なし」の3種のジェスチャーに対応付け、種別ごとに生成した動きを滑らかに統合することで、アバターやヒューマノイドロボットの会話ジェスチャーを自然に生成する手法を提案した。
著者: Hitoshi Teshima, Naoki Wake, Diego Thomas, Yuta Nakashima, Hiroshi Kawasaki, Katsushi Ikeuchi
分類: cs.RO, cs.MM
原文アブストラクト
Body language such as conversational gesture is a powerful way to ease communication. Conversational gestures do not only make a speech more lively but also contain semantic meaning that helps to stress important information in the discussion. In the field of robotics, giving conversational agents (humanoid robots or virtual avatars) the ability to properly use gestures is critical, yet remain a task of extraordinary difficulty. This is because given only a text as input, there are many possibilities and ambiguities to generate an appropriate gesture. Different to previous works we propose a new method that explicitly takes into account the gesture types to reduce these ambiguities and generate human-like conversational gestures. Key to our proposed system is a new gesture database built on the TED dataset that allows us to map a word to one of three types of gestures: "Imagistic" gestures, which express the content of the speech, "Beat" gestures, which emphasize words, and "No gestures." We propose a system that first maps the words in the input text to their corresponding gesture type, generate type-specific gestures and combine the generated gestures into one final smooth gesture. In our comparative experiments, the effectiveness of the proposed method was confirmed in user studies for both avatar and humanoid robot.
