裸指によるテクスチャ表面探索時の触覚・聴覚・視覚同時計測データセット
Concurrent Haptic, Audio, and Visual Data Set During Bare Finger Interaction with Textured Surfaces
人が指でテクスチャ表面をなぞる際の触覚・音・映像を同時収録したデータセットを構築し、機械学習で分類評価した。マルチモーダル分類は97%に達し、触覚単独(約80%)を上回った。
著者: Alexis W. M. Devillard, Aruna Ramasamy, Damien Faux, Vincent Hayward, Etienne Burdet
分類: cs.RO
原文アブストラクト
Perceptual processes are frequently multi-modal. This is the case of haptic perception. Data sets of visual and haptic sensory signals have been compiled in the past, especially when it comes to the exploration of textured surfaces. These data sets were intended to be used in natural and artificial perception studies and to provide training data sets for machine learning research. These data sets were typically acquired with rigid probes or artificial robotic fingers. Here, we collected visual, auditory, and haptic signals acquired when a human finger explored textured surfaces. We assessed the data set via machine learning classification techniques. Interestingly, multi-modal classification performance could reach 97% when haptic classification was around 80%.
