手作業デモ動画からの相互作用・活動認識と異常検知への応用
Automatic Interaction and Activity Recognition from Videos of Human Manual Demonstrations with Application to Anomaly Detection
シーングラフを用いて動画中の物体と手の時空間関係を抽出し、手作業の相互作用と活動を自動認識・クラスタリングする手法を提案。異常検知にも応用可能。
著者: Elena Merlo, Marta Lagomarsino, Edoardo Lamon, Arash Ajoudani
分類: cs.CV, cs.RO
原文アブストラクト
This paper presents a new method to describe spatio-temporal relations between objects and hands, to recognize both interactions and activities within video demonstrations of manual tasks. The approach exploits Scene Graphs to extract key interaction features from image sequences while simultaneously encoding motion patterns and context. Additionally, the method introduces event-based automatic video segmentation and clustering, which allow for the grouping of similar events and detect if a monitored activity is executed correctly. The effectiveness of the approach was demonstrated in two multi-subject experiments, showing the ability to recognize and cluster hand-object and object-object interactions without prior knowledge of the activity, as well as matching the same activity performed by different subjects.
