動的神経好奇心が自律的目標発見のための学習柔軟性を高める
Dynamic Neural Curiosity Enhances Learning Flexibility for Autonomous Goal Discovery
青斑核-ノルアドレナリン系に着想を得た動的神経場モデルで好奇心と注意を統合し、ロボットアームが物体を押す多様な目標を自律的に発見・学習する手法を提案。
著者: Quentin Houbre, Roel Pieters
分類: cs.RO, cs.AI, cs.LG
原文アブストラクト
The autonomous learning of new goals in robotics remains a complex issue to address. Here, we propose a model where curiosity influence learning flexibility. To do so, this paper proposes to root curiosity and attention together by taking inspiration from the Locus Coeruleus-Norepinephrine system along with various cognitive processes such as cognitive persistence and visual habituation. We apply our approach by experimenting with a simulated robotic arm on a set of objects with varying difficulty. The robot first discovers new goals via bottom-up attention through motor babbling with an inhibition of return mechanism, then engage to the learning of goals due to neural activity arising within the curiosity mechanism. The architecture is modelled with dynamic neural fields and the learning of goals such as pushing the objects in diverse directions is supported by the use of forward and inverse models implemented by multi-layer perceptrons. The adoption of dynamic neural fields to model curiosity, habituation and persistence allows the robot to demonstrate various learning trajectories depending on the object. In addition, the approach exhibits interesting properties regarding the learning of similar goals as well as the continuous switch between exploration and exploitation.
