日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

行動認識arXiv:2405.08695

物体ベースタスクにおけるゼロショット多ラベル行動認識への構成性の影響

The impact of Compositionality in Zero-shot Multi-label action recognition for Object-based tasks

シェア:XThreadsFacebookLINEはてブBluesky

VCLIPとDualCoOpを組み合わせたDual-VCLIPを提案し、訓練時は2つのプロンプトのみを学習する簡素な手法で、Charadesデータセット上のゼロショット多ラベル行動認識を実現した。

著者: Carmela Calabrese, Stefano Berti, Giulia Pasquale, Lorenzo Natale

分類: cs.CV, cs.RO

原文アブストラクト

Addressing multi-label action recognition in videos represents a significant challenge for robotic applications in dynamic environments, especially when the robot is required to cooperate with humans in tasks that involve objects. Existing methods still struggle to recognize unseen actions or require extensive training data. To overcome these problems, we propose Dual-VCLIP, a unified approach for zero-shot multi-label action recognition. Dual-VCLIP enhances VCLIP, a zero-shot action recognition method, with the DualCoOp method for multi-label image classification. The strength of our method is that at training time it only learns two prompts, and it is therefore much simpler than other methods. We validate our method on the Charades dataset that includes a majority of object-based actions, demonstrating that -- despite its simplicity -- our method performs favorably with respect to existing methods on the complete dataset, and promising performance when tested on unseen actions. Our contribution emphasizes the impact of verb-object class-splits during robots' training for new cooperative tasks, highlighting the influence on the performance and giving insights into mitigating biases.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

MINISFORUM(ミニPC)

MINISFORUM(ミニPC)の公式広告バナーMINISFORUM公式ストアを見る ↗
PR本紙発行元 EmplifAI