単語埋め込みによる意味情報を活用した骨格ベース行動認識
Including Semantic Information via Word Embeddings for Skeleton-based Action Recognition
骨格ベースの行動認識において、ワンホットエンコーディングを単語埋め込みによる意味ボリュームに置き換え、関節と物体の意味的関係を捉えることで、組立作業の分類性能と汎化性能を向上させた。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Dustin Aganian, Erik Franze, Markus Eisenbach, Horst-Michael Gross
分類: cs.CV, cs.LG, cs.RO
原文アブストラクト
Effective human action recognition is widely used for cobots in Industry 4.0 to assist in assembly tasks. However, conventional skeleton-based methods often lose keypoint semantics, limiting their effectiveness in complex interactions. In this work, we introduce a novel approach to skeleton-based action recognition that enriches input representations by leveraging word embeddings to encode semantic information. Our method replaces one-hot encodings with semantic volumes, enabling the model to capture meaningful relationships between joints and objects. Through extensive experiments on multiple assembly datasets, we demonstrate that our approach significantly improves classification performance, and enhances generalization capabilities by simultaneously supporting different skeleton types and object classes. Our findings highlight the potential of incorporating semantic information to enhance skeleton-based action recognition in dynamic and diverse environments.
