日本フィジカルAI新聞

世界のフィジカルAIを、日本語で。

強化学習/外乱ロバスト制御arXiv:1907.04514

外乱オブザーバ統合型強化学習による未知の過大時変外乱の能動的除去

DOB-Net: Actively Rejecting Unknown Excessive Time-Varying Disturbances

シェア:XThreadsFacebookLINEはてブBluesky

RNNで未知の時変外乱を推定・予測するオブザーバと制御器を強化学習で統合し、制御能力を超える外乱にも能動的に対抗するDOB-Netを提案した論文。

著者: Tianming Wang, Wenjie Lu, Zheng Yan, Dikai Liu

分類: cs.RO, cs.LG, cs.SY, eess.SY

原文アブストラクト

This paper presents an observer-integrated Reinforcement Learning (RL) approach, called Disturbance OBserver Network (DOB-Net), for robots operating in environments where disturbances are unknown and time-varying, and may frequently exceed robot control capabilities. The DOB-Net integrates a disturbance dynamics observer network and a controller network. Originated from conventional DOB mechanisms, the observer is built and enhanced via Recurrent Neural Networks (RNNs), encoding estimation of past values and prediction of future values of unknown disturbances in RNN hidden state. Such encoding allows the controller generate optimal control signals to actively reject disturbances, under the constraints of robot control capabilities. The observer and the controller are jointly learned within policy optimization by advantage actor critic. Numerical simulations on position regulation tasks have demonstrated that the proposed DOB-Net significantly outperforms a conventional feedback controller and classical RL algorithms.

  1. 1Boston Dynamics、車輪付きAtlasの研究試作機を紹介研究・技術
  2. 2newmoとKDDIが資本業務提携 2028年に堺市で自動運転タクシー商用化目指す提携・買収
  3. 3GXOとApptronik、Apolloの物流現場試験を拡大 最大1,000台の展開を構想量産・展開
  4. 4NVIDIA、CoRLでGR00T 2とIsaac Lab 3.0を発表新製品・発表
  5. 5UC BerkeleyとNVIDIAの研究者、AIエージェントでロボット制御コードを仮想環境で改善研究・技術

PR・アフィリエイト広告

MINISFORUM(ミニPC)

MINISFORUM(ミニPC)の公式広告バナーMINISFORUM公式ストアを見る ↗
PR本紙発行元 EmplifAI