遠隔操作のためのマルチモーダルインターフェースの効果検証
Multimodal Interfaces for Effective Teleoperation
視覚・聴覚・触覚の全組み合わせを比較し、VRヘッドマウントディスプレイによる立体視が作業成績を40%向上させるなど、各モダリティの貢献度を明らかにした。
著者: Eleftherios Triantafyllidis, Christopher McGreavy, Jiacheng Gu, Zhibin Li
分類: cs.HC, cs.RO
原文アブストラクト
Research in multi-modal interfaces aims to provide solutions to immersion and increase overall human performance. A promising direction is combining auditory, visual and haptic interaction between the user and the simulated environment. However, no extensive comparisons exist to show how combining audiovisuohaptic interfaces affects human perception reflected on task performance. Our paper explores this idea. We present a thorough, full-factorial comparison of how all combinations of audio, visual and haptic interfaces affect performance during manipulation. We evaluate how each interface combination affects performance in a study (N=25) consisting of manipulating tasks of varying difficulty. Performance is assessed using both subjective, assessing cognitive workload and system usability, and objective measurements, incorporating time and spatial accuracy-based metrics. Results show that regardless of task complexity, using stereoscopic-vision with the VRHMD increased performance across all measurements by 40% compared to monocular-vision from the display monitor. Using haptic feedback improved outcomes by 10% and auditory feedback accounted for approximately 5% improvement.
