民生RGB-Dカメラによる指差しジェスチャ検出の実用化
Commodifying Pointing in HRI: Simple and Fast Pointing Gesture Detection from RGB-D Images
民生品のRGB-Dカメラと深層学習ベースの手・顔検出を組み合わせ、3D指差しベクトルを30Hz以上で推定する簡便な手法を提案し、モーションキャプチャとの比較で精度を評価した。
著者: Bita Azari, Angelica Lim, Richard T. Vaughan
分類: cs.RO
原文アブストラクト
We present and characterize a simple method for detecting pointing gestures suitable for human-robot interaction applications using a commodity RGB-D camera. We exploit a state-of-the-art Deep CNN-based detector to find hands and faces in RGB images, then examine the corresponding depth channel pixels to obtain full 3D pointing vectors. We test several methods of estimating the hand end-point of the pointing vector. The system runs at better than 30Hz on commodity hardware: exceeding the frame rate of typical RGB-D sensors. An estimate of the absolute pointing accuracy is found empirically by comparison with ground-truth data from a VICON motion-capture system, and the useful interaction volume established. Finally, we show an end-to-end test where a robot estimates where the pointing vector intersects the ground plane, and report the accuracy obtained. We provide source code as a ROS node, with the intention of contributing a commodity implementation of this common component in HRI systems.
