CogNav: LLMによる物体目標ナビゲーションの認知プロセスモデリング
CogNav: Cognitive Process Modeling for Object Goal Navigation with LLMs
大規模言語モデルを用いて人間の物体探索時の認知状態遷移を有限状態機械でモデル化し、未知環境での物体目標ナビゲーションの成功率を向上させた研究。
著者: Yihan Cao, Jiazhao Zhang, Zhinan Yu, Shuzhen Liu, Zheng Qin, Qin Zou, Bo Du, Kai Xu
分類: cs.CV, cs.RO
原文アブストラクト
Object goal navigation (ObjectNav) is a fundamental task in embodied AI, requiring an agent to locate a target object in previously unseen environments. This task is particularly challenging because it requires both perceptual and cognitive processes, including object recognition and decision-making. While substantial advancements in perception have been driven by the rapid development of visual foundation models, progress on the cognitive aspect remains constrained, primarily limited to either implicit learning through simulator rollouts or explicit reliance on predefined heuristic rules. Inspired by neuroscientific findings demonstrating that humans maintain and dynamically update fine-grained cognitive states during object search tasks in novel environments, we propose CogNav, a framework designed to mimic this cognitive process using large language models. Specifically, we model the cognitive process using a finite state machine comprising fine-grained cognitive states, ranging from exploration to identification. Transitions between states are determined by a large language model based on a dynamically constructed heterogeneous cognitive map, which contains spatial and semantic information about the scene being explored. Extensive evaluations on the HM3D, MP3D, and RoboTHOR benchmarks demonstrate that our cognitive process modeling significantly improves the success rate of ObjectNav at least by relative 14% over the state-of-the-arts.
関連論文
- スケマティック誘導による物体目標ナビゲーション物体目標ナビゲーション
- 不確実性に応じて推論を切り替える物体探索ナビゲーション物体目標ナビゲーション
- F2A-ObjectNav: 物体目標ナビゲーションのための適応型エージェントアーキテクチャ物体目標ナビゲーション
- FOM-Nav: フロンティア物体マップによる物体目標ナビゲーション物体目標ナビゲーション
- EfficientNav: ナビゲーションマップのキャッシュと検索によるオンデバイス物体目標ナビゲーション物体目標ナビゲーション
- 物体目標ナビゲーションのための強化学習手法で重要な要素は何か?実証研究と統合フレームワーク物体目標ナビゲーション
