事前学習済みニューラルネットワークを用いた四足ロボットのロバストなバウンディング制御方策の効率的学習
Efficient Learning of Control Policies for Robust Quadruped Bounding using Pretrained Neural Networks
モデルベース制御のデータでNNを事前学習し、深層強化学習で微調整することで、四足ロボットのバウンディング歩容を効率的に学習させ、実機Jueying Miniで不整地走行を実現した。
著者: Zhicheng Wang, Anqiao Li, Yixiao Zheng, Anhuan Xie, Zhibin Li, Jun Wu, Qiuguo Zhu
分類: cs.RO, cs.AI
原文アブストラクト
Bounding is one of the important gaits in quadrupedal locomotion for negotiating obstacles. The authors proposed an effective approach that can learn robust bounding gaits more efficiently despite its large variation in dynamic body movements. The authors first pretrained the neural network (NN) based on data from a robot operated by conventional model based controllers, and then further optimised the pretrained NN via deep reinforcement learning (DRL). In particular, the authors designed a reward function considering contact points and phases to enforce the gait symmetry and periodicity, which improved the bounding performance. The NN based feedback controller was learned in the simulation and directly deployed on the real quadruped robot Jueying Mini successfully. A variety of environments are presented both indoors and outdoors with the authors approach. The authors approach shows efficient computing and good locomotion results by the Jueying Mini quadrupedal robot bounding over uneven terrain.
