日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

強化学習×古典制御arXiv:2101.07175

LQR制御を組み込んだ深層強化学習

Deep Reinforcement Learning with Embedded LQR Controllers

シェア:XThreadsFacebookLINEはてブBluesky

強化学習と古典的LQR制御を組み合わせ、目標状態でのチャタリングを抑えつつ到達・整定制御の性能を向上させる手法を比較提案した論文。

著者: Wouter Caarls

分類: cs.RO, cs.LG, cs.SY, eess.SY

原文アブストラクト

Reinforcement learning is a model-free optimal control method that optimizes a control policy through direct interaction with the environment. For reaching tasks that end in regulation, popular discrete-action methods are not well suited due to chattering in the goal state. We compare three different ways to solve this problem through combining reinforcement learning with classical LQR control. In particular, we introduce a method that integrates LQR control into the action set, allowing generalization and avoiding fixing the computed control in the replay memory if it is based on learned dynamics. We also embed LQR control into a continuous-action method. In all cases, we show that adding LQR control can improve performance, although the effect is more profound if it can be used to augment a discrete action set.

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3Google DeepMind、ロボット向けAIを発表新製品・発表
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開

PR・アフィリエイト広告

FRONTIER(GPU搭載BTOパソコン)

FRONTIER(GPU搭載BTOパソコン)の公式広告バナーFRONTIERでGPU搭載PCを見る ↗
PR本紙発行元 EmplifAI