日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

強化学習/水中ロボットarXiv:2002.01022

PID制御と強化学習を組み合わせた自律水中ロボットの経路追従

Proportional integral derivative controller assisted reinforcement learning for path following by autonomous underwater vehicles

シェア:XThreadsFacebookLINEはてブBluesky

6自由度の自律水中ロボットの経路追従に対し、深層強化学習を単独で使う手法とPID制御を組み合わせてアクチュエータごとに分割制御する手法を比較検討した論文。

著者: Simen Theie Havenstrøm, Camilla Sterud, Adil Rasheed, Omer San

分類: eess.SY, cs.RO, cs.SY

原文アブストラクト

Control theory provides engineers with a multitude of tools to design controllers that manipulate the closed-loop behavior and stability of dynamical systems. These methods rely heavily on insights about the mathematical model governing the physical system. However, if a system is highly complex, it might be infeasible to produce a reliable mathematical model of the system. Without a model most of the theoretical tools to develop control laws break down. In these settings, machine learning controllers become attractive: Controllers that can learn and adapt to complex systems, developing control laws where the engineer cannot. This article focuses on utilizing machine learning controllers in practical applications, specifically using deep reinforcement learning in motion control systems for an autonomous underwater vehicle with six degrees-of-freedom. Two methods are considered: end-to-end learning, where the vehicle is left entirely alone to explore the solution space in its search for an optimal policy, and PID assisted learning, where the DRL controller is essentially split into three separate parts, each controlling its own actuator.

関連論文

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI