動的に学習されるニューラル暗黙表現によるマルチオブジェクトナビゲーション
Multi-Object Navigation with dynamically learned neural implicit representations
各エピソード中に動的に学習される2つのニューラル暗黙表現(物体位置予測と占有・探索情報)を強化学習エージェントの記憶として用い、マルチオブジェクトナビゲーションの性能を向上させた研究。
著者: Pierre Marza, Laetitia Matignon, Olivier Simonin, Christian Wolf
分類: cs.CV, cs.LG, cs.RO
原文アブストラクト
Understanding and mapping a new environment are core abilities of any autonomously navigating agent. While classical robotics usually estimates maps in a stand-alone manner with SLAM variants, which maintain a topological or metric representation, end-to-end learning of navigation keeps some form of memory in a neural network. Networks are typically imbued with inductive biases, which can range from vectorial representations to birds-eye metric tensors or topological structures. In this work, we propose to structure neural networks with two neural implicit representations, which are learned dynamically during each episode and map the content of the scene: (i) the Semantic Finder predicts the position of a previously seen queried object; (ii) the Occupancy and Exploration Implicit Representation encapsulates information about explored area and obstacles, and is queried with a novel global read mechanism which directly maps from function space to a usable embedding space. Both representations are leveraged by an agent trained with Reinforcement Learning (RL) and learned online during each episode. We evaluate the agent on Multi-Object Navigation and show the high impact of using neural implicit representations as a memory source.
