意味論的Transformerによる地図注意を用いた効率的な視覚ナビゲーション
MaAST: Map Attention with Semantic Transformersfor Efficient Visual Navigation
RGB・深度・セマンティック情報を統合したトップダウン地図表現と2次元地図注意機構を提案し、経験量を80%削減しつつ屋内PointGoal視覚ナビゲーションで既存手法を上回る性能を示した。
著者: Zachary Seymour, Kowshik Thopalli, Niluthpol Mithun, Han-Pang Chiu, Supun Samarasekera, Rakesh Kumar
分類: cs.CV, cs.RO
原文アブストラクト
Visual navigation for autonomous agents is a core task in the fields of computer vision and robotics. Learning-based methods, such as deep reinforcement learning, have the potential to outperform the classical solutions developed for this task; however, they come at a significantly increased computational load. Through this work, we design a novel approach that focuses on performing better or comparable to the existing learning-based solutions but under a clear time/computational budget. To this end, we propose a method to encode vital scene semantics such as traversable paths, unexplored areas, and observed scene objects -- alongside raw visual streams such as RGB, depth, and semantic segmentation masks -- into a semantically informed, top-down egocentric map representation. Further, to enable the effective use of this information, we introduce a novel 2-D map attention mechanism, based on the successful multi-layer Transformer networks. We conduct experiments on 3-D reconstructed indoor PointGoal visual navigation and demonstrate the effectiveness of our approach. We show that by using our novel attention schema and auxiliary rewards to better utilize scene semantics, we outperform multiple baselines trained with only raw inputs or implicit semantic information while operating with an 80% decrease in the agent's experience.
関連論文
- 履歴観測からの証拠的BEV補完による視覚ナビゲーション視覚ナビゲーション
- オプティカルフローから安全へ:スケールフリー相対運動による視覚的安全認証視覚ナビゲーション
- VIGOR-MPC: 視覚誘導型目的調整MPC視覚ナビゲーション
- SkipWorld: 蒸留ワールドモデルによる潜在スキップ計画で効率的な視覚ナビゲーション視覚ナビゲーション
- RingNav: タスクに合わせた円環メモリによる視覚的方位推定視覚ナビゲーション
- PathLift:視覚ナビゲーションのための深度条件付きメートル法変換視覚ナビゲーション
