前腕超音波によるハンドジェスチャ分類のセッション間再現性向上:インクリメンタル学習アプローチ
Improving Intersession Reproducibility for Forearm Ultrasound based Hand Gesture Classification through an Incremental Learning Approach
前腕の超音波画像を用いたハンドジェスチャ分類において、プローブの位置ずれによる精度低下を解決するため、複数セッションのデータでインクリメンタルなファインチューニングを行い、約10%の精度向上を実現した。
著者: Keshav Bimbraw, Jack Rothenberg, Haichong K. Zhang
分類: cs.CV, cs.RO
原文アブストラクト
Ultrasound images of the forearm can be used to classify hand gestures towards developing human machine interfaces. In our previous work, we have demonstrated gesture classification using ultrasound on a single subject without removing the probe before evaluation. This has limitations in usage as once the probe is removed and replaced, the accuracy declines since the classifier performance is sensitive to the probe location on the arm. In this paper, we propose training a model on multiple data collection sessions to create a generalized model, utilizing incremental learning through fine tuning. Ultrasound data was acquired for 5 hand gestures within a session (without removing and putting the probe back on) and across sessions. A convolutional neural network (CNN) with 5 cascaded convolution layers was used for this study. A pre-trained CNN was fine tuned with the convolution blocks acting as a feature extractor, and the parameters of the remaining layers updated in an incremental fashion. Fine tuning was done using different session splits within a session and between multiple sessions. We found that incremental fine tuning can help enhance classification accuracy with more fine tuning sessions. After 2 fine tuning sessions for each experiment, we found an approximate 10% increase in classification accuracy. This work demonstrates that incremental learning through fine tuning on ultrasound based hand gesture classification can be used improves accuracy while saving storage, processing power, and time. It can be expanded to generalize between multiple subjects and towards developing personalized wearable devices.
関連論文
- エッジデバイス上での前腕超音波によるジェスチャー認識超音波センシング
- 超音波画像を用いた手首関節角度の連続推定超音波センシング
- 前腕超音波画像によるMCP関節角度予測と手形状分類超音波センシング
- 回転式超音波センサアレイによるL字型表面再構成のための最小エントロピー類似手法超音波センシング
