重み付きエントロピーによるSoft Actor-Criticの改良
Weighted Entropy Modification for Soft Actor-Critic
状態行動ペアに質的な重みを導入して最大エントロピー原理を重み付きエントロピーに一般化し、自己バランス型の探索を実現するSoft Actor-Criticアルゴリズムを提案した。MuJoCoタスクで最先端性能を達成。
著者: Yizhou Zhao, Song-Chun Zhu
分類: cs.LG, cs.RO
原文アブストラクト
We generalize the existing principle of the maximum Shannon entropy in reinforcement learning (RL) to weighted entropy by characterizing the state-action pairs with some qualitative weights, which can be connected with prior knowledge, experience replay, and evolution process of the policy. We propose an algorithm motivated for self-balancing exploration with the introduced weight function, which leads to state-of-the-art performance on Mujoco tasks despite its simplicity in implementation.
