身体ジェスチャーでドローンを操作する自然ユーザーインターフェースの実装
Implementation of a Natural User Interface to Command a Drone
OpenPoseでユーザーの姿勢をリアルタイム認識し、幾何学的制約を用いて身体ジェスチャーを高レベルなドローン指令に変換するROSベースの直感的操作システムを構築・実証した。
著者: Brandon Yam-Viramontes, Diego Mercado-Ravell
分類: cs.HC, cs.RO
原文アブストラクト
In this work, we propose the use of a Natural User Interface (NUI) through body gestures using the open source library OpenPose, looking for a more dynamic and intuitive way to control a drone. For the implementation, we use the Robotic Operative System (ROS) to control and manage the different components of the project. Wrapped inside ROS, OpenPose (OP) processes the video obtained in real-time by a commercial drone, allowing to obtain the user's pose. Finally, the keypoints from OpenPose are obtained and translated, using geometric constraints, to specify high-level commands to the drone. Real-time experiments validate the full strategy.
