渦流を横切るロボット魚の効率的ナビゲーション
Efficient Navigation of a Robotic Fish Swimming Across the Vortical Flow Field
LSTMを用いた深層強化学習により、カルマン渦列のような非定常渦流中をロボット魚が効率的に航行できる制御方策を学習させた。
著者: Haodong Feng, Dehan Yuan, Jiale Miao, Jie You, Yue Wang, Yi Zhu, Dixia Fan
分類: cs.RO, cs.SY, eess.SY
原文アブストラクト
Navigating efficiently across vortical flow fields presents a significant challenge in various robotic applications. The dynamic and unsteady nature of vortical flows often disturbs the control of underwater robots, complicating their operation in hydrodynamic environments. Conventional control methods, which depend on accurate modeling, fail in these settings due to the complexity of fluid-structure interactions (FSI) caused by unsteady hydrodynamics. This study proposes a deep reinforcement learning (DRL) algorithm, trained in a data-driven manner, to enable efficient navigation of a robotic fish swimming across vortical flows. Our proposed algorithm incorporates the LSTM architecture and uses several recent consecutive observations as the state to address the issue of partial observation, often due to sensor limitations. We present a numerical study of navigation within a Karman vortex street, created by placing a stationary cylinder in a uniform flow, utilizing the immersed boundary-lattice Boltzmann method (IB-LBM). The aim is to train the robotic fish to discover efficient navigation policies, enabling it to reach a designated target point across the Karman vortex street from various initial positions. After training, the fish demonstrates the ability to rapidly reach the target from different initial positions, showcasing the effectiveness and robustness of our proposed algorithm. Analysis of the results reveals that the robotic fish can leverage velocity gains and pressure differences induced by the vortices to reach the target, underscoring the potential of our proposed algorithm in enhancing navigation in complex hydrodynamic environments.
関連論文
- 動的障害物環境での安全飛行のための予測リスク誘導強化学習強化学習/ナビゲーション
- ManeuverNet: ダブルアクカーマン操舵ロボットの精密操縦のための報酬関数最適化を伴うSoft Actor-Criticフレームワーク強化学習/ナビゲーション
- 二重アクカーマン操舵ロボットの安全な機動のためのSoft Actor-Criticフレームワーク強化学習/ナビゲーション
- 分布強化学習に基づく自律水上艇の統合的意思決定と制御強化学習/ナビゲーション
- 自動運転車の安全クリティカル制御のための強化学習強化学習/ナビゲーション
- FastRLAP: 深層強化学習と自律練習による高速走行学習システム強化学習/ナビゲーション
