確率的探索を用いた適応型リスク感応モデル予測制御
Adaptive Risk Sensitive Model Predictive Control with Stochastic Search
初期状態・確率的ダイナミクス・不確かなパラメータの不確実性を扱い、確率的探索でCVaRを最適化する枠組みを提案し、振り子や台車棒、クアッドコプターで有効性を示した。
著者: Ziyi Wang, Oswin So, Keuntaek Lee, Camilo A. Duarte, Evangelos A. Theodorou
分類: math.OC, cs.RO
原文アブストラクト
We present a general framework for optimizing the Conditional Value-at-Risk for dynamical systems using stochastic search. The framework is capable of handling the uncertainty from the initial condition, stochastic dynamics, and uncertain parameters in the model. The algorithm is compared against a risk-sensitive distributional reinforcement learning framework and demonstrates outperformance on a pendulum and cartpole with stochastic dynamics. We also showcase the applicability of the framework to robotics as an adaptive risk-sensitive controller by optimizing with respect to the fully nonlinear belief provided by a particle filter on a pendulum, cartpole, and quadcopter in simulation.
