Actor-Critic型物理情報ニューラルリアプノフ制御
Actor-Critic Physics-informed Neural Lyapunov Control
ZubovのPDEを活用したactor-critic学習により、制御制約下で安定化ニューラルネットワーク制御器とリアプノフ証明を同時に訓練し、吸引領域を最大化する手法を提案。
著者: Jiarui Wang, Mahyar Fazlyab
分類: cs.LG, cs.RO, cs.SY, eess.SY
原文アブストラクト
Designing control policies for stabilization tasks with provable guarantees is a long-standing problem in nonlinear control. A crucial performance metric is the size of the resulting region of attraction, which essentially serves as a robustness "margin" of the closed-loop system against uncertainties. In this paper, we propose a new method to train a stabilizing neural network controller along with its corresponding Lyapunov certificate, aiming to maximize the resulting region of attraction while respecting the actuation constraints. Crucial to our approach is the use of Zubov's Partial Differential Equation (PDE), which precisely characterizes the true region of attraction of a given control policy. Our framework follows an actor-critic pattern where we alternate between improving the control policy (actor) and learning a Zubov function (critic). Finally, we compute the largest certifiable region of attraction by invoking an SMT solver after the training procedure. Our numerical experiments on several design problems show consistent and significant improvements in the size of the resulting region of attraction.
