CPGを使わないEnd-to-End強化学習による敏捷な遊泳制御
Learning Agile Swimming: An End-to-End Approach without CPGs
中央パターン生成器(CPG)に頼らず、深層強化学習でロボット魚の低レベルアクチュエータ指令を直接生成し、CFDシミュレータとsim-to-realキャリブレーションにより実機へ転移可能な敏捷・省エネ遊泳を実現した。
著者: Xiaozhu Lin, Xiaopei Liu, Yang Wang
分類: cs.RO
原文アブストラクト
The pursuit of agile and efficient underwater robots, especially bio-mimetic robotic fish, has been impeded by challenges in creating motion controllers that are able to fully exploit their hydrodynamic capabilities. This paper addresses these challenges by introducing a novel, model-free, end-to-end control framework that leverages Deep Reinforcement Learning (DRL) to enable agile and energy-efficient swimming of robotic fish. Unlike existing methods that rely on predefined trigonometric swimming patterns like Central Pattern Generators (CPG), our approach directly outputs low-level actuator commands without strong constraints, enabling the robotic fish to learn agile swimming behaviors. In addition, by integrating a high-performance Computational Fluid Dynamics (CFD) simulator with innovative sim-to-real strategies, such as normalized density calibration and servo response calibration, the proposed framework significantly mitigates the sim-to-real gap, facilitating direct transfer of control policies to real-world environments without fine-tuning. Comparative experiments demonstrate that our method achieves faster swimming speeds, smaller turn-around radii, and reduced energy consumption compared to the state-of-the-art swimming controllers. Furthermore, the proposed framework shows promise in addressing complex tasks, paving the way for more effective deployment of robotic fish in real aquatic environments.
