子どもとロボットの共同注意課題におけるマルチビュー関与度推定の深層学習手法
A Deep Learning Approach for Multi-View Engagement Estimation of Children in a Child-Robot Joint Attention task
部屋に設置した複数のRGB-Dカメラから子どもの姿勢を抽出・統合し、再帰層を含む深層ネットワークでロボットとの協働時の関与度を推定する手法を提案した。
著者: Jack Hadfield, Georgia Chalvatzaki, Petros Koutras, Mehdi Khamassi, Costas S. Tzafestas, Petros Maragos
分類: cs.RO, cs.CV, cs.LG
原文アブストラクト
In this work we tackle the problem of child engagement estimation while children freely interact with a robot in their room. We propose a deep-based multi-view solution that takes advantage of recent developments in human pose detection. We extract the child's pose from different RGB-D cameras placed elegantly in the room, fuse the results and feed them to a deep neural network trained for classifying engagement levels. The deep network contains a recurrent layer, in order to exploit the rich temporal information contained in the pose data. The resulting method outperforms a number of baseline classifiers, and provides a promising tool for better automatic understanding of a child's attitude, interest and attention while cooperating with a robot. The goal is to integrate this model in next generation social robots as an attention monitoring tool during various CRI tasks both for Typically Developed (TD) children and children affected by autism (ASD).
