好奇心とエピソード記憶によるロボットの高次元感覚空間探索
Intrinsic Motivation and Episodic Memories for Robot Exploration of High-Dimensional Sensory Spaces
画像センサを持つロボットが好奇心駆動で目標指向探索を行うアーキテクチャを提案し、エピソード記憶を組み込むことでオンライン学習時の破滅的忘却を防ぎ、学習の可塑性と安定性のバランスを調整できることを示した。
著者: Guido Schillaci, Antonio Pico Villalpando, Verena Vanessa Hafner, Peter Hanappe, David Colliaux, Timothée Wintz
分類: cs.AI, cs.LG, cs.RO
原文アブストラクト
This work presents an architecture that generates curiosity-driven goal-directed exploration behaviours for an image sensor of a microfarming robot. A combination of deep neural networks for offline unsupervised learning of low-dimensional features from images, and of online learning of shallow neural networks representing the inverse and forward kinematics of the system have been used. The artificial curiosity system assigns interest values to a set of pre-defined goals, and drives the exploration towards those that are expected to maximise the learning progress. We propose the integration of an episodic memory in intrinsic motivation systems to face catastrophic forgetting issues, typically experienced when performing online updates of artificial neural networks. Our results show that adopting an episodic memory system not only prevents the computational models from quickly forgetting knowledge that has been previously acquired, but also provides new avenues for modulating the balance between plasticity and stability of the models.
