オンライン非確率制御入門
Introduction to Online Control
オンライン凸最適化と凸緩和を用いて、敵対的なコスト関数とモデル摂動に対しても低い後悔を達成するオンライン非確率制御の枠組みを紹介する。
著者: Elad Hazan, Karan Singh
分類: cs.LG, cs.RO, cs.SY, eess.SY, math.OC, stat.ML
原文アブストラクト
This text presents an introduction to an emerging paradigm in control of dynamical systems and differentiable reinforcement learning called online nonstochastic control. The new approach applies techniques from online convex optimization and convex relaxations to obtain new methods with provable guarantees for classical settings in optimal and robust control. The primary distinction between online nonstochastic control and other frameworks is the objective. In optimal control, robust control, and other control methodologies that assume stochastic noise, the goal is to perform comparably to an offline optimal strategy. In online nonstochastic control, both the cost functions as well as the perturbations from the assumed dynamical model are chosen by an adversary. Thus the optimal policy is not defined a priori. Rather, the target is to attain low regret against the best policy in hindsight from a benchmark class of policies. This objective suggests the use of the decision making framework of online convex optimization as an algorithmic methodology. The resulting methods are based on iterative mathematical optimization algorithms, and are accompanied by finite-time regret and computational complexity guarantees.
