物体ナビゲーションにおける終了判断の学習
Learning to Terminate in Object Navigation
深層強化学習による物体ナビゲーションで、物体ごとの深度を推論して終了を判断するJudge Modelを導入し、長いエピソードでの成功率を改善した。
著者: Yuhang Song, Anh Nguyen, Chun-Yi Lee
分類: cs.RO, cs.CV
原文アブストラクト
This paper tackles the critical challenge of object navigation in autonomous navigation systems, particularly focusing on the problem of target approach and episode termination in environments with long optimal episode length in Deep Reinforcement Learning (DRL) based methods. While effective in environment exploration and object localization, conventional DRL methods often struggle with optimal path planning and termination recognition due to a lack of depth information. To overcome these limitations, we propose a novel approach, namely the Depth-Inference Termination Agent (DITA), which incorporates a supervised model called the Judge Model to implicitly infer object-wise depth and decide termination jointly with reinforcement learning. We train our judge model along with reinforcement learning in parallel and supervise the former efficiently by reward signal. Our evaluation shows the method is demonstrating superior performance, we achieve a 9.3% gain on success rate than our baseline method across all room types and gain 51.2% improvements on long episodes environment while maintaining slightly better Success Weighted by Path Length (SPL). Code and resources, visualization are available at: https://github.com/HuskyKingdom/DITA_acml2023
関連論文
- 動く前に探索方針を決める:拡散モデル生成の探索参照を用いた半静的環境でのゼロショット物体ナビゲーション物体ナビゲーション
- HTCE:同相写像に着想を得た物体ナビゲーションのためのシーン横断経験の正規化と再利用物体ナビゲーション
- SOR-Nav: 探索継続か領域移動か?文脈ゲート付き探索と領域間移動による物体ナビゲーション物体ナビゲーション
- NaviScale: 物体ナビゲーション向け大規模セマンティックマップデータセットの生成物体ナビゲーション
- ユーザー中心物体ナビゲーション:個人の習慣を統合したパーソナライズド物体探索ベンチマーク物体ナビゲーション
- Hydra-Nav: 適応的二重プロセス推論による物体ナビゲーション物体ナビゲーション
