深層強化学習による6自由度自律水中ロボットの省エネ位置制御
Toward 6-DOF Autonomous Underwater Vehicle Energy-Aware Position Control based on Deep Reinforcement Learning: Preliminary Results
6自由度ホロノミックAUVの制御にTQCアルゴリズムを適用し、手動調整なしで目標点到達と消費電力削減を両立できることをシミュレーションで示した。
著者: Gustavo Boré, Vicente Sufán, Sebastián Rodríguez-Martínez, Giancarlo Troni
分類: cs.RO, cs.LG, cs.SY, eess.SY
原文アブストラクト
The use of autonomous underwater vehicles (AUVs) for surveying, mapping, and inspecting unexplored underwater areas plays a crucial role, where maneuverability and power efficiency are key factors for extending the use of these platforms, making six degrees of freedom (6-DOF) holonomic platforms essential tools. Although Proportional-Integral-Derivative (PID) and Model Predictive Control controllers are widely used in these applications, they often require accurate system knowledge, struggle with repeatability when facing payload or configuration changes, and can be time-consuming to fine-tune. While more advanced methods based on Deep Reinforcement Learning (DRL) have been proposed, they are typically limited to operating in fewer degrees of freedom. This paper proposes a novel DRL-based approach for controlling holonomic 6-DOF AUVs using the Truncated Quantile Critics (TQC) algorithm, which does not require manual tuning and directly feeds commands to the thrusters without prior knowledge of their configuration. Furthermore, it incorporates power consumption directly into the reward function. Simulation results show that the TQC High-Performance method achieves better performance to a fine-tuned PID controller when reaching a goal point, while the TQC Energy-Aware method demonstrates slightly lower performance but consumes 30% less power on average.
関連論文
- 自律サンゴ礁モニタリングのための文脈型マルチタスク強化学習強化学習/水中ロボット
- 深層強化学習による自律型水中ロボットの3D経路追従と衝突回避制御強化学習/水中ロボット
- PID制御と強化学習を組み合わせた自律水中ロボットの経路追従強化学習/水中ロボット
- 強化学習による自律型水中ロボット制御のレビュー強化学習/水中ロボット
- モデルフリー強化学習によるAUVの深度制御強化学習/水中ロボット
