CogExplore: 言語で符号化された環境表現を用いた文脈的探索
CogExplore: Contextual Exploration with Language-Encoded Environment Representations
大規模言語モデル(GPT-3.5やClaude Haiku)を活用し、意味情報や文脈手がかり、時間的状態を自然言語で推論することで、未探索環境におけるロボット探索の経路距離を大幅に短縮する手法を提案。
著者: Harel Biggie, Patrick Cooper, Doncey Albin, Kristen Such, Christoffer Heckman
分類: cs.RO
原文アブストラクト
Integrating language models into robotic exploration frameworks improves performance in unmapped environments by providing the ability to reason over semantic groundings, contextual cues, and temporal states. The proposed method employs large language models (GPT-3.5 and Claude Haiku) to reason over these cues and express that reasoning in terms of natural language, which can be used to inform future states. We are motivated by the context of search-and-rescue applications where efficient exploration is critical. We find that by leveraging natural language, semantics, and tracking temporal states, the proposed method greatly reduces exploration path distance and further exposes the need for environment-dependent heuristics. Moreover, the method is highly robust to a variety of environments and noisy vision detections, as shown with a 100% success rate in a series of comprehensive experiments across three different environments conducted in a custom simulation pipeline operating in Unreal Engine.
