Pepper上でのリアルタイム骨格抽出とジェスチャー認識
Real-Time Online Skeleton Extraction and Gesture Recognition on Pepper
PepperロボットにGPUと魚眼カメラを搭載し、深層CNNを用いてリアルタイムで骨格抽出とジェスチャー認識を同時に行うシステムを構築した。未知のジェスチャーにも対応する手法を提案する。
著者: Axel Lefrant, Jean-Marc Montanier
分類: cs.RO, cs.CV
原文アブストラクト
We present a multi-stage pipeline for simple gesture recognition. The novelty of our approach is the association of different technologies, resulting in the first real-time system as of now to conjointly extract skeletons and recognise gesture on a Pepper robot. For this task, Pepper has been augmented with an embedded GPU for running deep CNNs and a fish-eye camera to capture whole scene interaction. We show in this article that real-case scenarios are challenging, and the state-of-the-art approaches hardly deal with unknown human gestures. We present here a way to handle such cases.
