ZoomTouch：ジェスチャー認識によるZoom上の複数ユーザー遠隔ロボット操作
ZoomTouch: Multi-User Remote Robot Control in Zoom by DNN-based Gesture Recognition
Zoom会議の映像からDNNでジェスチャーを認識し、複数ユーザーがリアルタイムで遠隔ロボットを操作して物体を巧みに扱える技術を提案。COVID-19検査ラボでの応用を例示。
著者: Ilya Zakharkin, Arman Tsaturyan, Miguel Altamirano-Cabrera, Jonathan Tirado, Dzmitry Tsetserukou
分類: cs.RO
原文アブストラクト
We present ZoomTouch - a breakthrough technology for multi-user control of robot from Zoom in real-time by DNN-based gesture recognition. The users from digital world can have a video conferencing and manipulate the robot to make the dexterous manipulations with tangible objects. As the scenario, we proposed the remote COVID-19 test Laboratory to considerably reduce the time to receive the data and substitute medical assistant working in protective gear in close proximity with infected cells. The proposed technology suggests a new type of reality, where multi-users can jointly interact with remote object, e.g. make a new building design, joint cooking in robotic kitchen, etc, and discuss/modify the results at the same time.
