視触覚学習による柔軟ハンドでの挿入作業
Visuotactile-Based Learning for Insertion with Compliant Hands
柔軟なアンダーアクチュエートハンドでの挿入作業に向け、視覚と触覚を組み合わせたマルチモーダル方策をシミュレーションで学習し、実機に転移させた研究。
著者: Osher Azulay, Dhruv Metha Ramesh, Nimrod Curtis, Avishai Sintov
分類: cs.RO
原文アブストラクト
Compared to rigid hands, underactuated compliant hands offer greater adaptability to object shapes, provide stable grasps, and are often more cost-effective. However, they introduce uncertainties in hand-object interactions due to their inherent compliance and lack of precise finger proprioception as in rigid hands. These limitations become particularly significant when performing contact-rich tasks like insertion. To address these challenges, additional sensing modalities are required to enable robust insertion capabilities. This letter explores the essential sensing requirements for successful insertion tasks with compliant hands, focusing on the role of visuotactile perception (i.e., visual and tactile perception). We propose a simulation-based multimodal policy learning framework that leverages all-around tactile sensing and an extrinsic depth camera. A transformer-based policy, trained through a teacher-student distillation process, is successfully transferred to a real-world robotic system without further training. Our results emphasize the crucial role of tactile sensing in conjunction with visual perception for accurate object-socket pose estimation, successful sim-to-real transfer and robust task execution.
