説明可能なOOHRI:拡張現実アフォーダンスとしてロボットの能力と限界を伝える
Explainable OOHRI: Communicating Robot Capabilities and Limitations as Augmented Reality Affordances
拡張現実と視覚言語モデルを用いて、ロボットの行動可能性と制約を視覚的に提示するインターフェースを開発し、ユーザーがロボットの限界を正確に理解し、混合主導で問題解決できることを示した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Lauren W. Wang, Mohamed Kari, Parastoo Abtahi
分類: cs.HC, cs.RO
原文アブストラクト
Human interaction is essential for issuing personalized instructions and assisting robots when failure is likely. However, robots remain largely black boxes, offering users little insight into their evolving capabilities and limitations. To address this gap, we present explainable object-oriented HRI (X-OOHRI), an augmented reality (AR) interface that conveys robot action possibilities and constraints through visual signifiers, radial menus, color coding, and explanation tags. Our system encodes object properties and robot limits into object-oriented structures using a vision-language model, allowing explanation generation on the fly and direct manipulation of virtual twins spatially aligned within a simulated environment. We integrate the end-to-end pipeline with a physical robot and showcase diverse use cases ranging from low-level pick-and-place to high-level instructions. Finally, we evaluate X-OOHRI through a user study and find that participants effectively issue object-oriented commands, develop accurate mental models of robot limitations, and engage in mixed-initiative resolution.
