生体模倣ニューラルネットワークと内在的リズム性を用いた四足歩行の学習
Learning Quadruped Locomotion using Bio-Inspired Neural Networks with Intrinsic Rhythmicity
脊髄のリズム生成回路(CPG)を微分可能なネットワークとして再定式化し、MLPと共に強化学習することで、不整地を盲歩行でき外乱にも耐える四足歩行方策を獲得した。
著者: Chuanyu Yang, Can Pu, Tianqi Wei, Cong Wang, Zhibin Li
分類: cs.RO
原文アブストラクト
Biological studies reveal that neural circuits located at the spinal cord called central pattern generator (CPG) oscillates and generates rhythmic signals, which are the underlying mechanism responsible for rhythmic locomotion behaviors of animals. Inspired by CPG's capability to naturally generate rhythmic patterns, researchers have attempted to create mathematical models of CPG and utilize them for the locomotion of legged robots. In this paper, we propose a network architecture that incorporates CPGs for rhythmic pattern generation and a multi-layer perceptron (MLP) network for sensory feedback. We also proposed a method that reformulates CPGs into a fully-differentiable stateless network, allowing CPGs and MLP to be jointly trained with gradient-based learning. The results show that our proposed method learned agile and dynamic locomotion policies which are capable of blind traversal over uneven terrain and resist external pushes. Simulation results also show that the learned policies are capable of self-modulating step frequency and step length to adapt to the locomotion velocity.
