深層強化学習によるエアホッケー打撃制御の学習
Learning Control for Air Hockey Striking using Deep Reinforcement Learning
エアホッケーのパックを狙って打つロボットのモーター制御を、モデルフリー深層強化学習で学習。事前知識の統合と経験リプレイの分布変化への対処で学習を安定化させた。
著者: Ayal Taitler, Nahum Shimkin
分類: cs.LG, cs.RO
原文アブストラクト
We consider the task of learning control policies for a robotic mechanism striking a puck in an air hockey game. The control signal is a direct command to the robot's motors. We employ a model free deep reinforcement learning framework to learn the motoric skills of striking the puck accurately in order to score. We propose certain improvements to the standard learning scheme which make the deep Q-learning algorithm feasible when it might otherwise fail. Our improvements include integrating prior knowledge into the learning scheme, and accounting for the changing distribution of samples in the experience replay buffer. Finally we present our simulation results for aimed striking which demonstrate the successful learning of this task, and the improvement in algorithm stability due to the proposed modifications.
