PID制御と強化学習を組み合わせた自律水中ロボットの経路追従
Proportional integral derivative controller assisted reinforcement learning for path following by autonomous underwater vehicles
6自由度の自律水中ロボットの経路追従に対し、深層強化学習を単独で使う手法とPID制御を組み合わせてアクチュエータごとに分割制御する手法を比較検討した論文。
著者: Simen Theie Havenstrøm, Camilla Sterud, Adil Rasheed, Omer San
分類: eess.SY, cs.RO, cs.SY
原文アブストラクト
Control theory provides engineers with a multitude of tools to design controllers that manipulate the closed-loop behavior and stability of dynamical systems. These methods rely heavily on insights about the mathematical model governing the physical system. However, if a system is highly complex, it might be infeasible to produce a reliable mathematical model of the system. Without a model most of the theoretical tools to develop control laws break down. In these settings, machine learning controllers become attractive: Controllers that can learn and adapt to complex systems, developing control laws where the engineer cannot. This article focuses on utilizing machine learning controllers in practical applications, specifically using deep reinforcement learning in motion control systems for an autonomous underwater vehicle with six degrees-of-freedom. Two methods are considered: end-to-end learning, where the vehicle is left entirely alone to explore the solution space in its search for an optimal policy, and PID assisted learning, where the DRL controller is essentially split into three separate parts, each controlling its own actuator.
関連論文
- 自律サンゴ礁モニタリングのための文脈型マルチタスク強化学習強化学習/水中ロボット
- 深層強化学習による6自由度自律水中ロボットの省エネ位置制御強化学習/水中ロボット
- 深層強化学習による自律型水中ロボットの3D経路追従と衝突回避制御強化学習/水中ロボット
- 強化学習による自律型水中ロボット制御のレビュー強化学習/水中ロボット
- モデルフリー強化学習によるAUVの深度制御強化学習/水中ロボット
