深度情報を活用した実環境での指示対象理解の改善
Using Depth for Improving Referring Expression Comprehension in Real-World Environments
ロボットが人間の指示した物体を見つけるタスクにおいて、RGB画像に深度情報を加えることで物体特定の精度を向上させる手法を提案した論文。
著者: Fethiye Irmak Dogan, Iolanda Leite
分類: cs.RO
原文アブストラクト
In a human-robot collaborative task where a robot helps its partner by finding described objects, the depth dimension plays a critical role in successful task completion. Existing studies have mostly focused on comprehending the object descriptions using RGB images. However, 3-dimensional space perception that includes depth information is fundamental in real-world environments. In this work, we propose a method to identify the described objects considering depth dimension data. Using depth features significantly improves performance in scenes where depth data is critical to disambiguate the objects and across our whole evaluation dataset that contains objects that can be specified with and without the depth dimension.
