視覚と触覚による継続的なマルチモーダル意図・注意認識で安全な物理的人間-ロボットインタラクションを実現
Vision- and tactile-based continuous multimodal intention and attention recognition for safer physical human-robot interaction
ロボットにカメラと触覚センサを搭載し、人間の姿勢や視線から接触が意図的か不意かを機械学習で判別、注意が逸れた際に安全機能を作動させる手法を提案。
著者: Christopher Yee Wong, Lucas Vergez, Wael Suleiman
分類: cs.RO
原文アブストラクト
Employing skin-like tactile sensors on robots enhances both the safety and usability of collaborative robots by adding the capability to detect human contact. Unfortunately, simple binary tactile sensors alone cannot determine the context of the human contact -- whether it is a deliberate interaction or an unintended collision that requires safety manoeuvres. Many published methods classify discrete interactions using more advanced tactile sensors or by analysing joint torques. Instead, we propose to augment the intention recognition capabilities of simple binary tactile sensors by adding a robot-mounted camera for human posture analysis. Different interaction characteristics, including touch location, human pose, and gaze direction, are used to train a supervised machine learning algorithm to classify whether a touch is intentional or not with an F1-score of 86%. We demonstrate that multimodal intention recognition is significantly more accurate than monomodal analyses with the collaborative robot Baxter. Furthermore, our method can also continuously monitor interactions that fluidly change between intentional or unintentional by gauging the user's attention through gaze. If a user stops paying attention mid-task, the proposed intention and attention recognition algorithm can activate safety features to prevent unsafe interactions. We also employ a feature reduction technique that reduces the number of inputs to five to achieve a more generalized low-dimensional classifier. This simplification both reduces the amount of training data required and improves real-world classification accuracy. It also renders the method potentially agnostic to the robot and touch sensor architectures while achieving a high degree of task adaptability.
関連論文
- シームレスな物理的人間-ヒューマノイドインタラクションに向けて:制御・意図・モデリングからの知見と今後の展望物理的人間-ロボットインタラクション
- せん断増粘流体に着想を得た物理的人間-ロボットインタラクションのための制御器物理的人間-ロボットインタラクション
- 階層的タスク下での効率的な物理的人間-ロボットインタラクションのための方向制約付き制御物理的人間-ロボットインタラクション
- 深層学習によるサブタスク検出と動作推定を用いた効率的で安全な接触リッチな物理的人間-ロボットインタラクション物理的人間-ロボットインタラクション
- 物体パラメータのオンライン推定を伴う人間-ロボット協調作業のための物体認識インピーダンス制御物理的人間-ロボットインタラクション
- 受動性に基づく安全な物理的人間-ロボットインタラクションの枠組み物理的人間-ロボットインタラクション
