ReStory: 視覚言語モデルによる社会的ヒューマンロボットインタラクションデータセットの拡張
ReStory: VLM-augmentation of Social Human-Robot Interaction Datasets
既存の実環境ヒューマンロボットインタラクションデータを視覚言語モデルで拡張し、絵コンテ形式の解釈可能なインタラクションシナリオを合成する手法ReStoryを提案。
分類: cs.RO, cs.HC
原文アブストラクト
Internet-scaled datasets are a luxury for human-robot interaction (HRI) researchers, as collecting natural interaction data in the wild is time-consuming and logistically challenging. The problem is exacerbated by robots' different form factors and interaction modalities. Inspired by recent work on ethnomethodological and conversation analysis (EMCA) in the domain of HRI, we propose ReStory, a method that has the potential to augment existing in-the-wild human-robot interaction datasets leveraging Vision Language Models. While still requiring human supervision, ReStory is capable of synthesizing human-interpretable interaction scenarios in the form of storyboards. We hope our proposed approach provides HRI researchers and interaction designers with a new angle to utilizing their valuable and scarce data.
