日常タスクにおける衝突リスクを説明する関係性未来キャプションモデル
Relational Future Captioning Model for Explaining Likely Collisions in Daily Tasks
家庭用サービスロボットが行動前に衝突リスクを説明できるよう、将来起こりうる事象をキャプション生成するクロスモーダルモデルRFCMを提案し、関係性自己注意エンコーダで事象間の関係を効果的に抽出して既存手法を上回る性能を示した。
著者: Motonari Kambara, Komei Sugiura
分類: cs.RO, cs.CL, cs.CV
原文アブストラクト
Domestic service robots that support daily tasks are a promising solution for elderly or disabled people. It is crucial for domestic service robots to explain the collision risk before they perform actions. In this paper, our aim is to generate a caption about a future event. We propose the Relational Future Captioning Model (RFCM), a crossmodal language generation model for the future captioning task. The RFCM has the Relational Self-Attention Encoder to extract the relationships between events more effectively than the conventional self-attention in transformers. We conducted comparison experiments, and the results show the RFCM outperforms a baseline method on two datasets.
