低周波数動作制御によるロバストで動的なロボット歩行の学習
Learning Low-Frequency Motion Control for Robust and Dynamic Robot Locomotion
深層強化学習を用いて、実機の四足歩行ロボットANYmal Cを8Hzという低い制御周波数で動かし、高速移動や不整地走破、外乱への耐性を実現した。低周波数ポリシーは遅延や動特性の変動に強く、sim-to-real転移が容易になることを示した。
著者: Siddhant Gangapurwala, Luigi Campanaro, Ioannis Havoutis
分類: cs.RO, cs.AI
原文アブストラクト
Robotic locomotion is often approached with the goal of maximizing robustness and reactivity by increasing motion control frequency. We challenge this intuitive notion by demonstrating robust and dynamic locomotion with a learned motion controller executing at as low as 8 Hz on a real ANYmal C quadruped. The robot is able to robustly and repeatably achieve a high heading velocity of 1.5 m/s, traverse uneven terrain, and resist unexpected external perturbations. We further present a comparative analysis of deep reinforcement learning (RL) based motion control policies trained and executed at frequencies ranging from 5 Hz to 200 Hz. We show that low-frequency policies are less sensitive to actuation latencies and variations in system dynamics. This is to the extent that a successful sim-to-real transfer can be performed even without any dynamics randomization or actuation modeling. We support this claim through a set of rigorous empirical evaluations. Moreover, to assist reproducibility, we provide the training and deployment code along with an extended analysis at https://ori-drs.github.io/lfmc/.
