時系列文脈と人間の動作ダイナミクスを活用した動画中のオンライン行動検出
Exploring Temporal Context and Human Movement Dynamics for Online Action Detection in Videos
時系列リカレントネットワークを基に、時系列文脈と人間の動作ダイナミクスを組み合わせて動画中の行動をリアルタイムに検出する手法を提案し、THUMOS'14で最先端の結果を達成した。
著者: Vasiliki I. Vasileiou, Nikolaos Kardaris, Petros Maragos
分類: cs.CV, cs.HC, cs.RO
原文アブストラクト
Nowadays, the interaction between humans and robots is constantly expanding, requiring more and more human motion recognition applications to operate in real time. However, most works on temporal action detection and recognition perform these tasks in offline manner, i.e. temporally segmented videos are classified as a whole. In this paper, based on the recently proposed framework of Temporal Recurrent Networks, we explore how temporal context and human movement dynamics can be effectively employed for online action detection. Our approach uses various state-of-the-art architectures and appropriately combines the extracted features in order to improve action detection. We evaluate our method on a challenging but widely used dataset for temporal action localization, THUMOS'14. Our experiments show significant improvement over the baseline method, achieving state-of-the art results on THUMOS'14.
