シミュレーション最適化によるクアッドロータのゼロショット方策転送の改善
Using Simulation Optimization to Improve Zero-shot Policy Transfer of Quadrotors
シミュレーションのパラメータをデータ駆動で最適化し、強化学習で訓練した制御方策を実機クアッドロータへ直接転送できるようにした研究。低レベル制御ほど高精度なシミュレーションが必要であることを実機実験で示した。
著者: Sven Gronauer, Matthias Kissel, Luca Sacchetto, Mathias Korte, Klaus Diepold
分類: cs.RO, cs.AI
原文アブストラクト
In this work, we propose a data-driven approach to optimize the parameters of a simulation such that control policies can be directly transferred from simulation to a real-world quadrotor. Our neural network-based policies take only onboard sensor data as input and run entirely on the embedded hardware. In extensive real-world experiments, we compare low-level Pulse-Width Modulated control with higher-level control structures such as Attitude Rate and Attitude, which utilize Proportional-Integral-Derivative controllers to output motor commands. Our experiments show that low-level controllers trained with reinforcement learning require a more accurate simulation than higher-level control policies.
