深層再帰型ニューラルネットワークによる人間らしい自然な動きの追跡
Tracking Human-like Natural Motion Using Deep Recurrent Neural Networks
単一のKinectセンサーの骨格追跡を深層再帰型ニューラルネットワークで補正し、関節位置と速度を改善する手法を提案した論文。
著者: Youngbin Park, Sungphill Moon, Il Hong Suh
分類: cs.CV, cs.LG, cs.NE, cs.RO
原文アブストラクト
Kinect skeleton tracker is able to achieve considerable human body tracking performance in convenient and a low-cost manner. However, The tracker often captures unnatural human poses such as discontinuous and vibrated motions when self-occlusions occur. A majority of approaches tackle this problem by using multiple Kinect sensors in a workspace. Combination of the measurements from different sensors is then conducted in Kalman filter framework or optimization problem is formulated for sensor fusion. However, these methods usually require heuristics to measure reliability of measurements observed from each Kinect sensor. In this paper, we developed a method to improve Kinect skeleton using single Kinect sensor, in which supervised learning technique was employed to correct unnatural tracking motions. Specifically, deep recurrent neural networks were used for improving joint positions and velocities of Kinect skeleton, and three methods were proposed to integrate the refined positions and velocities for further enhancement. Moreover, we suggested a novel measure to evaluate naturalness of captured motions. We evaluated the proposed approach by comparison with the ground truth obtained using a commercial optical maker-based motion capture system.
関連論文
- EgoWholeView:頭部搭載カメラのみによる身体と両手の動作キャプチャで身体性デモンストレーションを実現モーションキャプチャ
- 生体力学的知識を活用した多視点マーカーレス手の動きのモーションキャプチャモーションキャプチャ
- IMU-HOI: 接触を考慮した慣性融合による人間と物体の相互作用とモーションキャプチャの共生フレームワークモーションキャプチャ
- IMUと多体動力学モデルを密結合した運動・力学推定手法モーションキャプチャ
- 単眼イベントカメラによるモーションキャプチャシステムモーションキャプチャ
- CoCap: 屋外環境における複数人物シーンの協調モーションキャプチャモーションキャプチャ
