自然言語指示による物体運搬タスクの生成・実行・評価を完全自動化するフレームワーク
Fully Automated Task Management for Generation, Execution, and Evaluation: A Framework for Fetch-and-Carry Tasks with Natural Language Instructions in Continuous Space
連続空間でのFetch-and-Carryタスクを対象に、自然言語指示の生成からロボットの実行、評価までを自動化するフレームワークを提案し、タスクを4つのサブタスクに分割して解く手法を導入した。
著者: Motonari Kambara, Komei Sugiura
分類: cs.RO, cs.CL, cs.CV
原文アブストラクト
This paper aims to develop a framework that enables a robot to execute tasks based on visual information, in response to natural language instructions for Fetch-and-Carry with Object Grounding (FCOG) tasks. Although there have been many frameworks, they usually rely on manually given instruction sentences. Therefore, evaluations have only been conducted with fixed tasks. Furthermore, many multimodal language understanding models for the benchmarks only consider discrete actions. To address the limitations, we propose a framework for the full automation of the generation, execution, and evaluation of FCOG tasks. In addition, we introduce an approach to solving the FCOG tasks by dividing them into four distinct subtasks.
