経路積分と有限差分法による確率制約付き確率的最適制御
Chance-Constrained Stochastic Optimal Control via Path Integral and Finite Difference Methods
確率制約付き最適制御をラグランジュ緩和でリスク最小化問題に変換し、HJB方程式を経路積分法と有限差分法で解く手法を提案、2Dロボットナビゲーションで検証した。
著者: Apurva Patil, Alfredo Duarte, Aislinn Smith, Takashi Tanaka, Fabrizio Bisetti
分類: math.OC, cs.RO, cs.SY, eess.SY
原文アブストラクト
This paper addresses a continuous-time continuous-space chance-constrained stochastic optimal control (SOC) problem via a Hamilton-Jacobi-Bellman (HJB) partial differential equation (PDE). Through Lagrangian relaxation, we convert the chance-constrained (risk-constrained) SOC problem to a risk-minimizing SOC problem, the cost function of which possesses the time-additive Bellman structure. We show that the risk-minimizing control synthesis is equivalent to solving an HJB PDE whose boundary condition can be tuned appropriately to achieve a desired level of safety. Furthermore, it is shown that the proposed risk-minimizing control problem can be viewed as a generalization of the problem of estimating the risk associated with a given control policy. Two numerical techniques are explored, namely the path integral and the finite difference method (FDM), to solve a class of risk-minimizing SOC problems whose associated HJB equation is linearizable via the Cole-Hopf transformation. Using a 2D robot navigation example, we validate the proposed control synthesis framework and compare the solutions obtained using path integral and FDM.
