ドリフトなし不確実非線形系に対する適応アクター・クリティックに基づく最適制御
Adaptive Actor-Critic Based Optimal Regulation for Drift-Free Uncertain Nonlinear Systems
ドリフト項を持たず制御入力行列に不確かさがある非線形系に対し、同時学習によるパラメータ推定を組み込んだアクター・クリティック型強化学習制御器を提案し、画像ベースビジュアルサーボと車輪移動ロボットで有効性を示した。
著者: Ashwin P. Dani, Shubhendu Bhasin
分類: eess.SY, cs.RO, cs.SY
原文アブストラクト
In this paper, a continuous-time adaptive actor-critic reinforcement learning (RL) controller is developed for drift-free nonlinear systems. Practical examples of such systems are image-based visual servoing (IBVS) and wheeled mobile robots (WMR), where the system dynamics includes a parametric uncertainty in the control effectiveness matrix with no drift term. The uncertainty in the input term poses a challenge for developing a continuous-time RL controller using existing methods. In this paper, an actor-critic or synchronous policy iteration (PI)-based RL controller is presented with a concurrent learning (CL)-based parameter update law for estimating the unknown parameters of the control effectiveness matrix. An infinite-horizon value function minimization objective is achieved by regulating the current states to the desired with near-optimal control efforts. The proposed controller guarantees closed-loop stability and simulation results validate the proposed theory using IBVS and WMR examples.
関連論文
- 強化学習に基づくデータ駆動型モデル参照適応制御アプローチ適応制御/強化学習
