非線形・非定常・確率システムに対する凸データ駆動型逆最適制御
On Convex Data-Driven Inverse Optimal Control for Nonlinear, Non-stationary and Stochastic Systems
観測からエージェントの非凸・非定常なコストを復元する逆最適制御問題を、非線形・非定常・確率系でも凸最適化で解ける手法を提案し、実験で有効性を確認した。
著者: Emiland Garrabe, Hozefa Jesawada, Carmen Del Vecchio, Giovanni Russo
分類: math.OC, cs.IT, cs.LG, cs.RO, math.DS, math.IT
原文アブストラクト
This paper is concerned with a finite-horizon inverse control problem, which has the goal of reconstructing, from observations, the possibly non-convex and non-stationary cost driving the actions of an agent. In this context, we present a result enabling cost reconstruction by solving an optimization problem that is convex even when the agent cost is not and when the underlying dynamics is nonlinear, non-stationary and stochastic. To obtain this result, we also study a finite-horizon forward control problem that has randomized policies as decision variables. We turn our findings into algorithmic procedures and show the effectiveness of our approach via in-silico and hardware validations. All experiments confirm the effectiveness of our approach.
関連論文
- 単一レベル等式制約付き逆最適制御の信頼性逆最適制御
- 軌道断片から目的関数を逐次学習する逆最適制御逆最適制御
- 不完全な軌道観測からの逆最適制御逆最適制御
