注意機構による人間の意図推定・予測で触覚グローブ操作のロボットハンド制御を強化
Attention-based Estimation and Prediction of Human Intent to augment Haptic Glove aided Control of Robotic Hand
触覚グローブからロボットハンドへの動作信号の直接対応付けが難しい問題に対し、注意機構付きCNNで人間の意図を推定・予測し、通信遅延を補償して物体の把持・移動制御を改善した研究。
著者: Muneeb Ahmed, Rajesh Kumar, Qaim Abbas, Brejesh Lall, Arzad A. Kherani, Sudipto Mukherjee
分類: cs.RO, cs.AI
原文アブストラクト
The letter focuses on Haptic Glove (HG) based control of a Robotic Hand (RH) executing in-hand manipulation of certain objects of interest. The high dimensional motion signals in HG and RH possess intrinsic variability of kinematics resulting in difficulty to establish a direct mapping of the motion signals from HG onto the RH. An estimation mechanism is proposed to quantify the motion signal acquired from the human controller in relation to the intended goal pose of the object being held by the robotic hand. A control algorithm is presented to transform the synthesized intent at the RH and allow relocation of the object to the expected goal pose. The lag in synthesis of the intent in the presence of communication delay leads to a requirement of predicting the estimated intent. We leverage an attention-based convolutional neural network encoder to predict the trajectory of intent for a certain lookahead to compensate for the delays. The proposed methodology is evaluated across objects of different shapes, mass, and materials. We present a comparative performance of the estimation and prediction mechanisms on 5G-driven real-world robotic setup against benchmark methodologies. The test-MSE in prediction of human intent is reported to yield ~ 97.3 -98.7% improvement of accuracy in comparison to LSTM-based benchmark
関連論文
- MDF++: 視覚触覚ワールドアクションモデルのためのエンドツーエンド表現学習触覚/マニピュレーション
- DA-GRD: 知覚と実行の不一致下での触覚による把持回復のための意思決定を考慮した把持関連曖昧性解消触覚/マニピュレーション
- ME-Dex 1.0:異種触覚センシングを世界行動モデリングへ統合触覚/マニピュレーション
- Touch2Trace: 触覚駆動型模倣学習による巧みなケーブルトレース触覚/マニピュレーション
- TactileReflex: ノイズ統計駆動の視覚-触覚反射制御による力感応マニピュレーション触覚/マニピュレーション
- TEXterity:触覚による外部器用さ ― 触覚推定と制御の同時実行による把持物体操作触覚/マニピュレーション
