i-GSI:拡張現実とアイトラッキングによる高速で信頼性の高い把持タイプ切替インタフェース
i-GSI: A Fast and Reliable Grasp-type Switching Interface based on Augmented Reality and Eye-tracking
HoloLens2上でアイトラッキングとARを組み合わせ、視線でアイコンを見るだけで6種類の把持タイプを素早く切り替えられる義手用インタフェースを提案し、健常者と先天性上肢欠損患者で高い切替速度と成功率を実証した。
著者: Chunyuan Shi, Dapeng Yang, Siyang Qiu, Jingdong Zhao
分類: cs.RO
原文アブストラクト
The control of multi-fingered dexterous prosthetics hand remains challenging due to the lack of an intuitive and efficient Grasp-type Switching Interface (GSI). We propose a new GSI (i-GSI) t hat integrates the manifold power of eye-tracking and augmentced reality technologies to solve this problem. It runs entirely in a HoloLens2 helmet, where users can glance at icons on the holographic interface to switch between six daily grasp types quickly. Compared to traditional GSIs (FSM-based, PR-based, and mobile APP-based), i-GSI achieved the best results in the experiment with eight healthy subjects, achieving a switching time of 0.84 s, a switching success rate of 99.0%, and learning efficiency of 93.50%. By verifying on one patient with a congenital upper limb deficiency, i-GSI achieved an equivalent great outcome as on healthy people, with a switching time of 0.78 s and switching success rate of 100%. The new i-GSI, as a standalone module, can be combined with traditional proportional myoelectric control to form a hybrid-controlled prosthetic system that can help patients accomplish dexterous operations in various daily-life activities.
