触覚対応NewtonianVAEによる高精度産業用コネクタ挿入
Tactile-Sensitive NewtonianVAE for High-Accuracy Industrial Connector Insertion
GelSight型触覚センサを組み込んだNewtonianVAEで、把持姿勢のばらつきがあるUSBコネクタ挿入を高精度に行う手法を提案した論文。
著者: Ryo Okumura, Nobuki Nishio, Tadahiro Taniguchi
分類: cs.RO, cs.AI
原文アブストラクト
An industrial connector insertion task requires submillimeter positioning and grasp pose compensation for a plug. Thus, highly accurate estimation of the relative pose between a plug and socket is fundamental for achieving the task. World models are promising technologies for visuomotor control because they obtain appropriate state representation to jointly optimize feature extraction and latent dynamics model. Recent studies show that the NewtonianVAE, a type of the world model, acquires latent space equivalent to mapping from images to physical coordinates. Proportional control can be achieved in the latent space of NewtonianVAE. However, applying NewtonianVAE to high-accuracy industrial tasks in physical environments is an open problem. Moreover, the existing framework does not consider the grasp pose compensation in the obtained latent space. In this work, we proposed tactile-sensitive NewtonianVAE and applied it to a USB connector insertion with grasp pose variation in the physical environments. We adopted a GelSight-type tactile sensor and estimated the insertion position compensated by the grasp pose of the plug. Our method trains the latent space in an end-to-end manner, and no additional engineering and annotation are required. Simple proportional control is available in the obtained latent space. Moreover, we showed that the original NewtonianVAE fails in some situations, and demonstrated that domain knowledge induction improves model accuracy. This domain knowledge can be easily obtained using robot specification and grasp pose error measurement. We demonstrated that our proposed method achieved a 100\% success rate and 0.3 mm positioning accuracy in the USB connector insertion task in the physical environment. It outperformed SOTA CNN-based two-stage goal pose regression with grasp pose compensation using coordinate transformation.
関連論文
- MDF++: 視覚触覚ワールドアクションモデルのためのエンドツーエンド表現学習触覚/マニピュレーション
- DA-GRD: 知覚と実行の不一致下での触覚による把持回復のための意思決定を考慮した把持関連曖昧性解消触覚/マニピュレーション
- ME-Dex 1.0:異種触覚センシングを世界行動モデリングへ統合触覚/マニピュレーション
- Touch2Trace: 触覚駆動型模倣学習による巧みなケーブルトレース触覚/マニピュレーション
- TactileReflex: ノイズ統計駆動の視覚-触覚反射制御による力感応マニピュレーション触覚/マニピュレーション
- TEXterity:触覚による外部器用さ ― 触覚推定と制御の同時実行による把持物体操作触覚/マニピュレーション
