UltraGlove: MEMS超音波センサによるハンドポーズ推定
UltraGlove: Hand Pose Estimation with Mems-Ultrasonic Sensors
指に取り付けたMEMS超音波センサ間の距離行列から、軽量な深層学習モデルで手のポーズを推定する低コストなグローブ型デバイスを提案。
著者: Qiang Zhang, Yuanqiao Lin, Yubin Lin, Szymon Rusinkiewicz
分類: cs.CV, cs.GR, cs.HC, cs.RO
原文アブストラクト
Hand tracking is an important aspect of human-computer interaction and has a wide range of applications in extended reality devices. However, current hand motion capture methods suffer from various limitations. For instance, visual-based hand pose estimation is susceptible to self-occlusion and changes in lighting conditions, while IMU-based tracking gloves experience significant drift and are not resistant to external magnetic field interference. To address these issues, we propose a novel and low-cost hand-tracking glove that utilizes several MEMS-ultrasonic sensors attached to the fingers, to measure the distance matrix among the sensors. Our lightweight deep network then reconstructs the hand pose from the distance matrix. Our experimental results demonstrate that this approach is both accurate, size-agnostic, and robust to external interference. We also show the design logic for the sensor selection, sensor configurations, circuit diagram, as well as model architecture.
関連論文
- 適応的視覚-IMU融合による3Dハンドトラッキングハンドトラッキング
