実世界での触覚:ポータブル視触覚グリッパによる繊細なマニピュレーション学習
Touch in the Wild: Learning Fine-Grained Manipulation with a Portable Visuo-Tactile Gripper
触覚センサ内蔵のポータブルグリッパで視覚と触覚のデータを同時収集し、両モダリティの特性を保つ表現学習により、試験管挿入やピペット操作などの精密作業を高精度・高ロバストに実現した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Xinyue Zhu, Binghao Huang, Yunzhu Li
分類: cs.RO, cs.AI, cs.LG
原文アブストラクト
Handheld grippers are increasingly used to collect human demonstrations due to their ease of deployment and versatility. However, most existing designs lack tactile sensing, despite the critical role of tactile feedback in precise manipulation. We present a portable, lightweight gripper with integrated tactile sensors that enables synchronized collection of visual and tactile data in diverse, real-world, and in-the-wild settings. Building on this hardware, we propose a cross-modal representation learning framework that integrates visual and tactile signals while preserving their distinct characteristics. The learning procedure allows the emergence of interpretable representations that consistently focus on contacting regions relevant for physical interactions. When used for downstream manipulation tasks, these representations enable more efficient and effective policy learning, supporting precise robotic manipulation based on multimodal feedback. We validate our approach on fine-grained tasks such as test tube insertion and pipette-based fluid transfer, demonstrating improved accuracy and robustness under external disturbances. Our project page is available at https://binghao-huang.github.io/touch_in_the_wild/ .
