モデルフリー強化学習によるAUVの深度制御
Depth Control of Model-Free AUVs via Reinforcement Learning
未知のダイナミクスを持つ自律水中ロボット(AUV)の深度追従制御を、モデルフリー強化学習で学習する手法を提案し、シミュレーションと実海域データで有効性を示した。
著者: Hui Wu, Shiji Song, Keyou You, Cheng Wu
分類: cs.RO
原文アブストラクト
In this paper, we consider depth control problems of an autonomous underwater vehicle (AUV) for tracking the desired depth trajectories. Due to the unknown dynamical model of the AUV, the problems cannot be solved by most of model-based controllers. To this purpose, we formulate the depth control problems of the AUV as continuous-state, continuous-action Markov decision processes (MDPs) under unknown transition probabilities. Based on deterministic policy gradient (DPG) and neural network approximation, we propose a model-free reinforcement learning (RL) algorithm that learns a state-feedback controller from sampled trajectories of the AUV. To improve the performance of the RL algorithm, we further propose a batch-learning scheme through replaying previous prioritized trajectories. We illustrate with simulations that our model-free method is even comparable to the model-based controllers as LQI and NMPC. Moreover, we validate the effectiveness of the proposed RL algorithm on a seafloor data set sampled from the South China Sea.
関連論文
- 自律サンゴ礁モニタリングのための文脈型マルチタスク強化学習強化学習/水中ロボット
- 深層強化学習による6自由度自律水中ロボットの省エネ位置制御強化学習/水中ロボット
- 深層強化学習による自律型水中ロボットの3D経路追従と衝突回避制御強化学習/水中ロボット
- PID制御と強化学習を組み合わせた自律水中ロボットの経路追従強化学習/水中ロボット
- 強化学習による自律型水中ロボット制御のレビュー強化学習/水中ロボット
