言語ベース拡張による物体目標ナビゲーションのショートカット学習の解決
Language-Based Augmentation to Address Shortcut Learning in Object Goal Navigation
物体目標ナビゲーションにおいて、訓練環境の視覚的特徴に依存したショートカット学習が問題となることを示し、視覚言語モデルの特徴空間を利用した言語ベース拡張で汎化性能を改善する手法を提案した。
著者: Dennis Hoftijzer, Gertjan Burghouts, Luuk Spreeuwers
分類: cs.RO, cs.CV
原文アブストラクト
Deep Reinforcement Learning (DRL) has shown great potential in enabling robots to find certain objects (e.g., `find a fridge') in environments like homes or schools. This task is known as Object-Goal Navigation (ObjectNav). DRL methods are predominantly trained and evaluated using environment simulators. Although DRL has shown impressive results, the simulators may be biased or limited. This creates a risk of shortcut learning, i.e., learning a policy tailored to specific visual details of training environments. We aim to deepen our understanding of shortcut learning in ObjectNav, its implications and propose a solution. We design an experiment for inserting a shortcut bias in the appearance of training environments. As a proof-of-concept, we associate room types to specific wall colors (e.g., bedrooms with green walls), and observe poor generalization of a state-of-the-art (SOTA) ObjectNav method to environments where this is not the case (e.g., bedrooms with blue walls). We find that shortcut learning is the root cause: the agent learns to navigate to target objects, by simply searching for the associated wall color of the target object's room. To solve this, we propose Language-Based (L-B) augmentation. Our key insight is that we can leverage the multimodal feature space of a Vision-Language Model (VLM) to augment visual representations directly at the feature-level, requiring no changes to the simulator, and only an addition of one layer to the model. Where the SOTA ObjectNav method's success rate drops 69%, our proposal has only a drop of 23%.
関連論文
- スケマティック誘導による物体目標ナビゲーション物体目標ナビゲーション
- 不確実性に応じて推論を切り替える物体探索ナビゲーション物体目標ナビゲーション
- F2A-ObjectNav: 物体目標ナビゲーションのための適応型エージェントアーキテクチャ物体目標ナビゲーション
- FOM-Nav: フロンティア物体マップによる物体目標ナビゲーション物体目標ナビゲーション
- EfficientNav: ナビゲーションマップのキャッシュと検索によるオンデバイス物体目標ナビゲーション物体目標ナビゲーション
- 物体目標ナビゲーションのための強化学習手法で重要な要素は何か?実証研究と統合フレームワーク物体目標ナビゲーション
