ダイナミクスランダム化なしで実機に転移できる強化学習
Sim2Real Transfer for Reinforcement Learning without Dynamics Randomization
関節・直交座標制約付きの操作空間制御を用いて直交空間で強化学習を行い、システム同定と制約付き制御によりダイナミクスランダム化なしでKUKA LBR iiwaのペグ挿入タスクをシミュレーションから実機へ転移させた。
著者: Manuel Kaspar, Juan David Munoz Osorio, Jürgen Bock
分類: cs.AI, cs.LG, cs.RO
原文アブストラクト
In this work we show how to use the Operational Space Control framework (OSC) under joint and cartesian constraints for reinforcement learning in cartesian space. Our method is therefore able to learn fast and with adjustable degrees of freedom, while we are able to transfer policies without additional dynamics randomizations on a KUKA LBR iiwa peg in-hole task. Before learning in simulation starts, we perform a system identification for aligning the simulation environment as far as possible with the dynamics of a real robot. Adding constraints to the OSC controller allows us to learn in a safe way on the real robot or to learn a flexible, goal conditioned policy that can be easily transferred from simulation to the real robot.
