地図ベースのモジュラー手法によるゼロショット身体性質問応答
Map-based Modular Approach for Zero-shot Embodied Question Answering
基盤モデルと地図構築を組み合わせ、未知環境でロボットが自然言語の質問に答えるゼロショットEQA手法を提案し、実環境でも検証した。
著者: Koya Sakamoto, Daichi Azuma, Taiki Miyanishi, Shuhei Kurita, Motoaki Kawanabe
分類: cs.RO, cs.CV
原文アブストラクト
Embodied Question Answering (EQA) serves as a benchmark task to evaluate the capability of robots to navigate within novel environments and identify objects in response to human queries. However, existing EQA methods often rely on simulated environments and operate with limited vocabularies. This paper presents a map-based modular approach to EQA, enabling real-world robots to explore and map unknown environments. By leveraging foundation models, our method facilitates answering a diverse range of questions using natural language. We conducted extensive experiments in both virtual and real-world settings, demonstrating the robustness of our approach in navigating and comprehending queries within unknown environments.
