爪画像から指先の力・トルク・接触面曲率を推定
Estimating Fingertip Forces, Torques, and Local Curvatures from Fingernail Images
指の爪と周辺皮膚の変形・色分布を画像から解析し、様々な物体把持時の指先力・トルク・接触面曲率を推定する手法を提案。複数指への拡張も実現。
著者: Nutan Chen, Göran Westling, Benoni B. Edin, Patrick van der Smagt
分類: cs.RO, cs.CV, cs.LG, stat.ML
原文アブストラクト
The study of dexterous manipulation has provided important insights in humans sensorimotor control as well as inspiration for manipulation strategies in robotic hands. Previous work focused on experimental environment with restrictions. Here we describe a method using the deformation and color distribution of the fingernail and its surrounding skin, to estimate the fingertip forces, torques and contact surface curvatures for various objects, including the shape and material of the contact surfaces and the weight of the objects. The proposed method circumvents limitations associated with sensorized objects, gloves or fixed contact surface type. In addition, compared with previous single finger estimation in an experimental environment, we extend the approach to multiple finger force estimation, which can be used for applications such as human grasping analysis. Four algorithms are used, c.q., Gaussian process (GP), Convolutional Neural Networks (CNN), Neural Networks with Fast Dropout (NN-FD) and Recurrent Neural Networks with Fast Dropout (RNN-FD), to model a mapping from images to the corresponding labels. The results further show that the proposed method has high accuracy to predict force, torque and contact surface.
