ロボットアームのリーチングタスクにおける強化学習の実験とベンチマーク
Reinforcement Learning Experiments and Benchmark for Solving Robotic Reaching Tasks
ロボットアームのリーチングタスクを対象に、複数のモデルフリー強化学習アルゴリズムを比較する再現可能な実験手順を定義し、シミュレーションで学習した方策を実機に転移。Hindsight Experience Replayの併用でオフポリシー手法の平均リターンが7〜9倍向上することを示した。
著者: Pierre Aumjaud, David McAuliffe, Francisco Javier Rodríguez Lera, Philip Cardiff
分類: cs.RO, cs.AI, cs.LG
原文アブストラクト
Reinforcement learning has shown great promise in robotics thanks to its ability to develop efficient robotic control procedures through self-training. In particular, reinforcement learning has been successfully applied to solving the reaching task with robotic arms. In this paper, we define a robust, reproducible and systematic experimental procedure to compare the performance of various model-free algorithms at solving this task. The policies are trained in simulation and are then transferred to a physical robotic manipulator. It is shown that augmenting the reward signal with the Hindsight Experience Replay exploration technique increases the average return of off-policy agents between 7 and 9 folds when the target position is initialised randomly at the beginning of each episode.
