日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

探索arXiv:2406.17180

CogExplore: 言語で符号化された環境表現を用いた文脈的探索

CogExplore: Contextual Exploration with Language-Encoded Environment Representations

シェア:XThreadsFacebookLINEはてブBluesky

大規模言語モデル(GPT-3.5やClaude Haiku)を活用し、意味情報や文脈手がかり、時間的状態を自然言語で推論することで、未探索環境におけるロボット探索の経路距離を大幅に短縮する手法を提案。

著者: Harel Biggie, Patrick Cooper, Doncey Albin, Kristen Such, Christoffer Heckman

分類: cs.RO

原文アブストラクト

Integrating language models into robotic exploration frameworks improves performance in unmapped environments by providing the ability to reason over semantic groundings, contextual cues, and temporal states. The proposed method employs large language models (GPT-3.5 and Claude Haiku) to reason over these cues and express that reasoning in terms of natural language, which can be used to inform future states. We are motivated by the context of search-and-rescue applications where efficient exploration is critical. We find that by leveraging natural language, semantics, and tracking temporal states, the proposed method greatly reduces exploration path distance and further exposes the need for environment-dependent heuristics. Moreover, the method is highly robust to a variety of environments and noisy vision detections, as shown with a 100% success rate in a series of comprehensive experiments across three different environments conducted in a custom simulation pipeline operating in Unreal Engine.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI