決定論的サンプリングとコロケーションによる直接方策最適化
Direct Policy Optimization using Deterministic Sampling and Collocation
直接軌道最適化・決定論的サンプリング・方策最適化を組み合わせ、準ニュートン法で参照軌道とサンプル軌道・パラメータ化方策を同時最適化するフィードバック運動計画法を提案した論文。
著者: Taylor A. Howell, Chunjiang Fu, Zachary Manchester
分類: cs.RO
原文アブストラクト
We present an approach for approximately solving discrete-time stochastic optimal-control problems by combining direct trajectory optimization, deterministic sampling, and policy optimization. Our feedback motion-planning algorithm uses a quasi-Newton method to simultaneously optimize a reference trajectory, a set of deterministically chosen sample trajectories, and a parameterized policy. We demonstrate that this approach exactly recovers LQR policies in the case of linear dynamics, quadratic objective, and Gaussian disturbances. We also demonstrate the algorithm on several nonlinear, underactuated robotic systems to highlight its performance and ability to handle control limits, safely avoid obstacles, and generate robust plans in the presence of unmodeled dynamics.
