非ガウス連続状態行動系における集中型モデル学習と計画
Focused Model-Learning and Planning for Non-Gaussian Continuous State-Action Systems
連続状態・行動空間で非ガウス遷移を持つ確率領域に対し、必要な局所モデルのみを学習し関連状態と高価値行動に計画を集中させる枠組みを提案し、多峰性押し操作問題で有効性を示した。
著者: Zi Wang, Stefanie Jegelka, Leslie Pack Kaelbling, Tomás Lozano-Pérez
分類: cs.AI, cs.LG, cs.RO, stat.AP, stat.ML
原文アブストラクト
We introduce a framework for model learning and planning in stochastic domains with continuous state and action spaces and non-Gaussian transition models. It is efficient because (1) local models are estimated only when the planner requires them; (2) the planner focuses on the most relevant states to the current planning problem; and (3) the planner focuses on the most informative and/or high-value actions. Our theoretical analysis shows the validity and asymptotic optimality of the proposed approach. Empirically, we demonstrate the effectiveness of our algorithm on a simulated multi-modal pushing problem.
