分散位相振動子による創発的歩容の学習:観測・報酬・フィードバックの役割
Learning Emergent Gaits with Decentralized Phase Oscillators: on the role of Observations, Rewards, and Feedback
各脚に独立した位相振動子を置き、接地力の局所フィードバックと位相観測・位相ベース報酬を組み合わせることで、歩容を指定せずに四足歩行の創発的な歩容を学習させる手法を提案し、その要素を体系的に検証した。
著者: Jenny Zhang, Steve Heim, Se Hwan Jeon, Sangbae Kim
分類: cs.RO, cs.LG
原文アブストラクト
We present a minimal phase oscillator model for learning quadrupedal locomotion. Each of the four oscillators is coupled only to itself and its corresponding leg through local feedback of the ground reaction force, which can be interpreted as an observer feedback gain. We interpret the oscillator itself as a latent contact state-estimator. Through a systematic ablation study, we show that the combination of phase observations, simple phase-based rewards, and the local feedback dynamics induces policies that exhibit emergent gait preferences, while using a reduced set of simple rewards, and without prescribing a specific gait. The code is open-source, and a video synopsis available at https://youtu.be/1NKQ0rSV3jU.
