ロボットの触覚に対する注意:堅牢なSim-to-Real触覚制御のための触覚顕著性予測
Attention for Robot Touch: Tactile Saliency Prediction for Robust Sim-to-Real Tactile Control
人間の触覚注意機構と視覚的顕著性予測に着想を得て、触覚画像中の重要な接触情報を特定する「触覚顕著性」の概念を提案し、接触深さ推定・顕著性予測・ノイズ生成の3ネットワークで実現した。
著者: Yijiong Lin, Mauro Comi, Alex Church, Dandan Zhang, Nathan F. Lepora
分類: cs.RO, cs.AI
原文アブストラクト
High-resolution tactile sensing can provide accurate information about local contact in contact-rich robotic tasks. However, the deployment of such tasks in unstructured environments remains under-investigated. To improve the robustness of tactile robot control in unstructured environments, we propose and study a new concept: \textit{tactile saliency} for robot touch, inspired by the human touch attention mechanism from neuroscience and the visual saliency prediction problem from computer vision. In analogy to visual saliency, this concept involves identifying key information in tactile images captured by a tactile sensor. While visual saliency datasets are commonly annotated by humans, manually labelling tactile images is challenging due to their counterintuitive patterns. To address this challenge, we propose a novel approach comprised of three interrelated networks: 1) a Contact Depth Network (ConDepNet), which generates a contact depth map to localize deformation in a real tactile image that contains target and noise features; 2) a Tactile Saliency Network (TacSalNet), which predicts a tactile saliency map to describe the target areas for an input contact depth map; 3) and a Tactile Noise Generator (TacNGen), which generates noise features to train the TacSalNet. Experimental results in contact pose estimation and edge-following in the presence of distractors showcase the accurate prediction of target features from real tactile images. Overall, our tactile saliency prediction approach gives robust sim-to-real tactile control in environments with unknown distractors. Project page: https://sites.google.com/view/tactile-saliency/.
