全方位の力覚を高精度に知覚する親指サイズの柔らかい視覚式触覚センサ
A soft thumb-sized vision-based sensor with accurate all-round force perception
単眼カメラとフォトメトリックステレオ・構造光を組み合わせ、親指サイズの柔軟な触覚センサで接触面全体の力の大きさと方向を高精度に推定した研究。
著者: Huanbo Sun, Katherine J. Kuchenbecker, Georg Martius
分類: cs.RO, cs.CV, cs.LG, cs.SY, eess.SY
原文アブストラクト
Vision-based haptic sensors have emerged as a promising approach to robotic touch due to affordable high-resolution cameras and successful computer-vision techniques. However, their physical design and the information they provide do not yet meet the requirements of real applications. We present a robust, soft, low-cost, vision-based, thumb-sized 3D haptic sensor named Insight: it continually provides a directional force-distribution map over its entire conical sensing surface. Constructed around an internal monocular camera, the sensor has only a single layer of elastomer over-molded on a stiff frame to guarantee sensitivity, robustness, and soft contact. Furthermore, Insight is the first system to combine photometric stereo and structured light using a collimator to detect the 3D deformation of its easily replaceable flexible outer shell. The force information is inferred by a deep neural network that maps images to the spatial distribution of 3D contact force (normal and shear). Insight has an overall spatial resolution of 0.4 mm, force magnitude accuracy around 0.03 N, and force direction accuracy around 5 degrees over a range of 0.03--2 N for numerous distinct contacts with varying contact area. The presented hardware and software design concepts can be transferred to a wide variety of robot parts.
