連続カリキュラム学習による到達タスクの強化学習高速化
Accelerating Reinforcement Learning for Reaching using Continuous Curriculum Learning
到達タスクの強化学習において、要求精度を訓練中に徐々に調整する精度ベースの連続カリキュラム学習を提案し、実機とシミュレーションで静的スケジュールより高速・高精度に学習できることを示した。
著者: Sha Luo, Hamidreza Kasaei, Lambert Schomaker
分類: cs.AI, cs.RO
原文アブストラクト
Reinforcement learning has shown great promise in the training of robot behavior due to the sequential decision making characteristics. However, the required enormous amount of interactive and informative training data provides the major stumbling block for progress. In this study, we focus on accelerating reinforcement learning (RL) training and improving the performance of multi-goal reaching tasks. Specifically, we propose a precision-based continuous curriculum learning (PCCL) method in which the requirements are gradually adjusted during the training process, instead of fixing the parameter in a static schedule. To this end, we explore various continuous curriculum strategies for controlling a training process. This approach is tested using a Universal Robot 5e in both simulation and real-world multi-goal reach experiments. Experimental results support the hypothesis that a static training schedule is suboptimal, and using an appropriate decay function for curriculum learning provides superior results in a faster way.
