実世界における自己注意機構ベースの視覚ナビゲーションに向けて
Towards self-attention based visual navigation in the real world
自己注意機構を用いた視覚ナビゲーションエージェントのハイパーパラメータを体系的に探索し、シミュレーションで訓練したモデルが実世界の画像をリアルタイムで処理できることを示した。
著者: Jaime Ruiz-Serra, Jack White, Stephen Petrie, Tatiana Kameneva, Chris McCarthy
分類: cs.RO, cs.CV, cs.LG, cs.NE
原文アブストラクト
Vision guided navigation requires processing complex visual information to inform task-orientated decisions. Applications include autonomous robots, self-driving cars, and assistive vision for humans. A key element is the extraction and selection of relevant features in pixel space upon which to base action choices, for which Machine Learning techniques are well suited. However, Deep Reinforcement Learning agents trained in simulation often exhibit unsatisfactory results when deployed in the real-world due to perceptual differences known as the $\textit{reality gap}$. An approach that is yet to be explored to bridge this gap is self-attention. In this paper we (1) perform a systematic exploration of the hyperparameter space for self-attention based navigation of 3D environments and qualitatively appraise behaviour observed from different hyperparameter sets, including their ability to generalise; (2) present strategies to improve the agents' generalisation abilities and navigation behaviour; and (3) show how models trained in simulation are capable of processing real world images meaningfully in real time. To our knowledge, this is the first demonstration of a self-attention based agent successfully trained in navigating a 3D action space, using less than 4000 parameters.
関連論文
- 履歴観測からの証拠的BEV補完による視覚ナビゲーション視覚ナビゲーション
- オプティカルフローから安全へ:スケールフリー相対運動による視覚的安全認証視覚ナビゲーション
- VIGOR-MPC: 視覚誘導型目的調整MPC視覚ナビゲーション
- SkipWorld: 蒸留ワールドモデルによる潜在スキップ計画で効率的な視覚ナビゲーション視覚ナビゲーション
- RingNav: タスクに合わせた円環メモリによる視覚的方位推定視覚ナビゲーション
- PathLift:視覚ナビゲーションのための深度条件付きメートル法変換視覚ナビゲーション
