有限要素法によるマルコフ決定過程の状態連続近似と自律システム計画
State-Continuity Approximation of Markov Decision Processes via Finite Element Methods for Autonomous System Planning
遷移確率の1次・2次モーメントのみから連続状態空間の価値関数を有限要素法で直接求める、明示的遷移モデル不要の計画手法を提案し、経路の滑らかさや移動距離・時間で有効性を示した。
著者: Junhong Xu, Kai Yin, Lantao Liu
分類: cs.RO
原文アブストラクト
Motion planning under uncertainty for an autonomous system can be formulated as a Markov Decision Process with a continuous state space. In this paper, we propose a novel solution to this decision-theoretic planning problem that directly obtains the continuous value function with only the first and second moments of the transition probabilities, alleviating the requirement for an explicit transition model in the literature. We achieve this by expressing the value function as a linear combination of basis functions and approximating the Bellman equation by a partial differential equation, where the value function can be naturally constructed using a finite element method. We have validated our approach via extensive simulations, and the evaluations reveal that to baseline methods, our solution leads to in terms of path smoothness, travel distance, and time costs.
