抽象的な上面マップを用いた未知レイアウト迷路のナビゲーション学習
Learning to Navigate in Mazes with Novel Layouts using Abstract Top-down Maps
上面2Dマップを画像として読み取り、未知の迷路レイアウトでもゼロショットで経路探索できる強化学習モデルを提案した。
著者: Linfeng Zhao, Lawson L. S. Wong
分類: cs.LG, cs.AI, cs.RO
原文アブストラクト
Learning navigation capabilities in different environments has long been one of the major challenges in decision-making. In this work, we focus on zero-shot navigation ability using given abstract $2$-D top-down maps. Like human navigation by reading a paper map, the agent reads the map as an image when navigating in a novel layout, after learning to navigate on a set of training maps. We propose a model-based reinforcement learning approach for this multi-task learning problem, where it jointly learns a hypermodel that takes top-down maps as input and predicts the weights of the transition network. We use the DeepMind Lab environment and customize layouts using generated maps. Our method can adapt better to novel environments in zero-shot and is more robust to noise.
