経路積分型確率的最適制御のための漸進的サンプリングによる効率的軌道生成
Information-Theoretic Stochastic Optimal Control via Incremental Sampling-based Algorithms
経路積分に基づく確率的最適制御において、低コスト軌道を効率的にサンプリングするためにRRTなどの漸進的サンプリング手法を活用し、情報理論的最適制御との新たな関連性を示した研究。
著者: Oktay Arslan, Evangelos Theodorou, Panagiotis Tsiotras
分類: cs.RO, cs.SY, eess.SY
原文アブストラクト
This paper considers optimal control of dynamical systems which are represented by nonlinear stochastic differential equations. It is well-known that the optimal control policy for this problem can be obtained as a function of a value function that satisfies a nonlinear partial differential equation, namely, the Hamilton-Jacobi-Bellman equation. This nonlinear PDE must be solved backwards in time, and this computation is intractable for large scale systems. Under certain assumptions, and after applying a logarithmic transformation, an alternative characterization of the optimal policy can be given in terms of a path integral. Path Integral (PI) based control methods have recently been shown to provide elegant solutions to a broad class of stochastic optimal control problems. One of the implementation challenges with this formalism is the computation of the expectation of a cost functional over the trajectories of the unforced dynamics. Computing such expectation over trajectories that are sampled uniformly may induce numerical instabilities due to the exponentiation of the cost. Therefore, sampling of low-cost trajectories is essential for the practical implementation of PI-based methods. In this paper, we use incremental sampling-based algorithms to sample useful trajectories from the unforced system dynamics, and make a novel connection between Rapidly-exploring Random Trees (RRTs) and information-theoretic stochastic optimal control. We show the results from the numerical implementation of the proposed approach to several examples.
関連論文
- 連続時間確率制約付き確率的最適制御における強双対性と双対勾配上昇法確率的最適制御
- パラメータ化入力推論による制約付き確率的最適制御の近似解法確率的最適制御
- 確率的最適制御のための経路積分理論の開拓確率的最適制御
- 近似ベイズ入力推論による効率的な確率的最適制御確率的最適制御
- 確率的最適制御におけるFeynman-Kac前後方向SDEのための価値関数推定器確率的最適制御
- 前向き・後向きRRTによる確率的最適制御確率的最適制御
