本質的に動機づけられたオプション学習:最近の手法の比較研究
Intrinsically motivated option learning: a comparative study of recent methods
強化学習におけるオプション枠組みを、報酬なしで最適化できるempowerment概念に基づいて拡張した最近の手法群を、元来のempowerment原理の観点から比較検討した研究。
著者: Djordje Božić, Predrag Tadić, Mladen Nikolić
分類: cs.AI, cs.LG, cs.RO
原文アブストラクト
Options represent a framework for reasoning across multiple time scales in reinforcement learning (RL). With the recent active interest in the unsupervised learning paradigm in the RL research community, the option framework was adapted to utilize the concept of empowerment, which corresponds to the amount of influence the agent has on the environment and its ability to perceive this influence, and which can be optimized without any supervision provided by the environment's reward structure. Many recent papers modify this concept in various ways achieving commendable results. Through these various modifications, however, the initial context of empowerment is often lost. In this work we offer a comparative study of such papers through the lens of the original empowerment principle.
