Tactile Gym 2.0:低コスト高解像度触覚センサを比較するためのSim-to-Real深層強化学習
Tactile Gym 2.0: Sim-to-real Deep Reinforcement Learning for Comparing Low-cost High-Resolution Robot Touch
3種類の光学式触覚センサ(TacTip, DIGIT, DigiTac)を対象に、単一のsim-to-real手法で実機タスク(物体押し・エッジ追従・表面追従)を高精度に達成し、低コスト4自由度アームでベンチマークを拡張した。
著者: Yijiong Lin, John Lloyd, Alex Church, Nathan F. Lepora
分類: cs.RO
原文アブストラクト
High-resolution optical tactile sensors are increasingly used in robotic learning environments due to their ability to capture large amounts of data directly relating to agent-environment interaction. However, there is a high barrier of entry to research in this area due to the high cost of tactile robot platforms, specialised simulation software, and sim-to-real methods that lack generality across different sensors. In this letter we extend the Tactile Gym simulator to include three new optical tactile sensors (TacTip, DIGIT and DigiTac) of the two most popular types, Gelsight-style (image-shading based) and TacTip-style (marker based). We demonstrate that a single sim-to-real approach can be used with these three different sensors to achieve strong real-world performance despite the significant differences between real tactile images. Additionally, we lower the barrier of entry to the proposed tasks by adapting them to an inexpensive 4-DoF robot arm, further enabling the dissemination of this benchmark. We validate the extended environment on three physically-interactive tasks requiring a sense of touch: object pushing, edge following and surface following. The results of our experimental validation highlight some differences between these sensors, which may help future researchers select and customize the physical characteristics of tactile sensors for different manipulations scenarios.
関連論文
- TactileLab: せん断感覚を効率的にシミュレートする触覚シミュレーションによるSim-to-Real巧緻マニピュレーション触覚/sim2real
- TactSpace: 触覚のシミュレーションから実世界への転移のための物理強化共有潜在空間の学習触覚/sim2real
- HydroShear: 触覚シミュレーションから実機への強化学習のためのハイドロエラスティックせん断シミュレーション触覚/sim2real
- 触覚シミュレータを実写類似・ゼロショット性能で拡張するSightGAN触覚/sim2real
- 深層テクスチャ生成ネットワークによる触覚Sim2Realギャップの削減触覚/sim2real
- 物理シミュレーションと学習潜在投影による触覚センシングのsim-to-real触覚/sim2real
