確率的グラフィカルモデルを用いた連続状態系のための潜在KL制御
Latent Kullback Leibler Control for Continuous-State Systems using Probabilistic Graphical Models
連続状態系にKL制御を適用するため、観測変数を連続状態、潜在変数を離散低次元表現とする確率的グラフィカルモデルにKL制御を埋め込み、HMMと factorial HMMの2手法を提案しロボット運動制御タスクで検証した論文。
著者: Takamitsu Matsubara, Vicenç Gómez, Hilbert J. Kappen
分類: eess.SY, cs.RO, cs.SY
原文アブストラクト
Kullback Leibler (KL) control problems allow for efficient computation of optimal control by solving a principal eigenvector problem. However, direct applicability of such framework to continuous state-action systems is limited. In this paper, we propose to embed a KL control problem in a probabilistic graphical model where observed variables correspond to the continuous (possibly high-dimensional) state of the system and latent variables correspond to a discrete (low-dimensional) representation of the state amenable for KL control computation. We present two examples of this approach. The first one uses standard hidden Markov models (HMMs) and computes exact optimal control, but is only applicable to low-dimensional systems. The second one uses factorial HMMs, it is scalable to higher dimensional problems, but control computation is approximate. We illustrate both examples in several robot motor control tasks.
