失敗時に時間を巻き戻して強化学習を加速する手法
Time manipulation technique for speeding up reinforcement learning in simulations
シミュレーション内で失敗が起きた際に時間を巻き戻すことで、強化学習の学習速度と状態空間探索を改善する手法を提案した論文。
著者: Petar Kormushev, Kohei Nomoto, Fangyan Dong, Kaoru Hirota
分類: cs.AI, cs.LG, cs.RO
原文アブストラクト
A technique for speeding up reinforcement learning algorithms by using time manipulation is proposed. It is applicable to failure-avoidance control problems running in a computer simulation. Turning the time of the simulation backwards on failure events is shown to speed up the learning by 260% and improve the state space exploration by 12% on the cart-pole balancing task, compared to the conventional Q-learning and Actor-Critic algorithms.
