A0C: 連続行動空間におけるAlpha Zero
A0C: Alpha Zero in Continuous Action Space
Alpha Zeroを連続行動空間に拡張するための理論的拡張を提案し、振り子の振り上げタスクで予備実験を行って実現可能性を示した。
著者: Thomas M. Moerland, Joost Broekens, Aske Plaat, Catholijn M. Jonker
分類: stat.ML, cs.AI, cs.LG, cs.RO, cs.SY, eess.SY
原文アブストラクト
A core novelty of Alpha Zero is the interleaving of tree search and deep learning, which has proven very successful in board games like Chess, Shogi and Go. These games have a discrete action space. However, many real-world reinforcement learning domains have continuous action spaces, for example in robotic control, navigation and self-driving cars. This paper presents the necessary theoretical extensions of Alpha Zero to deal with continuous action space. We also provide some preliminary experiments on the Pendulum swing-up task, empirically showing the feasibility of our approach. Thereby, this work provides a first step towards the application of iterated search and learning in domains with a continuous action space.
