クロスモーダル自己教師あり学習による豊かな触覚表現の獲得
Learning rich touch representations through cross-modal self-supervision
触覚センサ付きの擬人化ロボットハンドで物体を触り、他モダリティとの対応を自己教師あり学習に用いて触覚特徴を学習し、未知物体・姿勢の少数ショット分類で有効性を示した研究。
著者: Martina Zambelli, Yusuf Aytar, Francesco Visin, Yuxiang Zhou, Raia Hadsell
分類: cs.RO
原文アブストラクト
The sense of touch is fundamental in several manipulation tasks, but rarely used in robot manipulation. In this work we tackle the problem of learning rich touch features from cross-modal self-supervision. We evaluate them identifying objects and their properties in a few-shot classification setting. Two new datasets are introduced using a simulated anthropomorphic robotic hand equipped with tactile sensors on both synthetic and daily life objects. Several self-supervised learning methods are benchmarked on these datasets, by evaluating few-shot classification on unseen objects and poses. Our experiments indicate that cross-modal self-supervision effectively improves touch representation, and in turn has great potential to enhance robot manipulation skills.
