OnlineHOI: オンライン人間-物体インタラクションの生成と知覚
OnlineHOI: Towards Online Human-Object Interaction Generation and Perception
ロボティクスやAR/VRで重要な人間-物体インタラクション(HOI)を、各時刻で現在と過去の情報のみを使うオンライン設定で生成・知覚する新タスクを提案し、Mambaとメモリ機構に基づくOnlineHOIフレームワークで高精度を達成した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Yihong Ji, Yunze Liu, Yiyao Zhuo, Weijiang Yu, Fei Ma, Joshua Huang, Fei Yu
分類: cs.CV, cs.AI, cs.RO
原文アブストラクト
The perception and generation of Human-Object Interaction (HOI) are crucial for fields such as robotics, AR/VR, and human behavior understanding. However, current approaches model this task in an offline setting, where information at each time step can be drawn from the entire interaction sequence. In contrast, in real-world scenarios, the information available at each time step comes only from the current moment and historical data, i.e., an online setting. We find that offline methods perform poorly in an online context. Based on this observation, we propose two new tasks: Online HOI Generation and Perception. To address this task, we introduce the OnlineHOI framework, a network architecture based on the Mamba framework that employs a memory mechanism. By leveraging Mamba's powerful modeling capabilities for streaming data and the Memory mechanism's efficient integration of historical information, we achieve state-of-the-art results on the Core4D and OAKINK2 online generation tasks, as well as the online HOI4D perception task.
関連論文
- 人間-物体インタラクション検出のための空間プライミング人間-物体インタラクション
