強化学習による可変剛性を用いた堅牢な歩行制御
Variable Stiffness for Robust Locomotion through Reinforcement Learning
脚式ロボットの歩行制御において、関節剛性を行動空間に組み込み、脚単位などのグループ剛性制御を可能にする強化学習手法を提案し、速度追従や外乱回復、エネルギー効率、実環境への転移性能を検証した。
著者: Dario Spoljaric, Yashuai Yan, Dongheui Lee
分類: cs.RO, cs.AI
原文アブストラクト
Reinforcement-learned locomotion enables legged robots to perform highly dynamic motions but often accompanies time-consuming manual tuning of joint stiffness. This paper introduces a novel control paradigm that integrates variable stiffness into the action space alongside joint positions, enabling grouped stiffness control such as per-joint stiffness (PJS), per-leg stiffness (PLS) and hybrid joint-leg stiffness (HJLS). We show that variable stiffness policies, with grouping in per-leg stiffness (PLS), outperform position-based control in velocity tracking and push recovery. In contrast, HJLS excels in energy efficiency. Despite the fact that our policy is trained on flat floor only, our method showcases robust walking behaviour on diverse outdoor terrains, indicating robust sim-to-real transfer. Our approach simplifies design by eliminating per-joint stiffness tuning while keeping competitive results with various metrics.
