接触音によるタッチジェスチャと感情認識で人とロボットのインタラクションを強化
Sound-Based Recognition of Touch Gestures and Emotions for Enhanced Human-Robot Interaction
人型ロボットPepperへの接触時に生じる音だけを用いて、タッチジェスチャと感情(覚醒度・感情価)を認識する軽量モデルを提案し、従来の音声認識モデルと同等の性能をより少ない計算量で実現した。
著者: Yuanbo Hou, Qiaoqiao Ren, Wenwu Wang, Dick Botteldooren
分類: cs.HC, cs.RO, cs.SD, eess.AS
原文アブストラクト
Emotion recognition and touch gesture decoding are crucial for advancing human-robot interaction (HRI), especially in social environments where emotional cues and tactile perception play important roles. However, many humanoid robots, such as Pepper, Nao, and Furhat, lack full-body tactile skin, limiting their ability to engage in touch-based emotional and gesture interactions. In addition, vision-based emotion recognition methods usually face strict GDPR compliance challenges due to the need to collect personal facial data. To address these limitations and avoid privacy issues, this paper studies the potential of using the sounds produced by touching during HRI to recognise tactile gestures and classify emotions along the arousal and valence dimensions. Using a dataset of tactile gestures and emotional interactions from 28 participants with the humanoid robot Pepper, we design an audio-only lightweight touch gesture and emotion recognition model with only 0.24M parameters, 0.94MB model size, and 0.7G FLOPs. Experimental results show that the proposed sound-based touch gesture and emotion recognition model effectively recognises the arousal and valence states of different emotions, as well as various tactile gestures, when the input audio length varies. The proposed model is low-latency and achieves similar results as well-known pretrained audio neural networks (PANNs), but with much smaller FLOPs, parameters, and model size.
