能動的知覚のための階層型アーキテクチャ:深層強化学習による画像分類
A Layered Architecture for Active Perception: Image Classification using Deep Reinforcement Learning
部分観測環境で画像分類を行うロボット向けに、目標決定・行動選択・分類評価の3層を深層強化学習で学習する手法を提案し、MNISTで検証した。
著者: Hossein K. Mousavi, Guangyi Liu, Weihang Yuan, Martin Takáč, Héctor Muñoz-Avila, Nader Motee
分類: cs.LG, cs.AI, cs.RO, cs.SY, eess.SY, stat.ML
原文アブストラクト
We propose a planning and perception mechanism for a robot (agent), that can only observe the underlying environment partially, in order to solve an image classification problem. A three-layer architecture is suggested that consists of a meta-layer that decides the intermediate goals, an action-layer that selects local actions as the agent navigates towards a goal, and a classification-layer that evaluates the reward and makes a prediction. We design and implement these layers using deep reinforcement learning. A generalized policy gradient algorithm is utilized to learn the parameters of these layers to maximize the expected reward. Our proposed methodology is tested on the MNIST dataset of handwritten digits, which provides us with a level of explainability while interpreting the agent's intermediate goals and course of action.
