サイバーフィジカル・ロボットシステムのための確率的オンライン最適化
Stochastic Online Optimization for Cyber-Physical and Robotic Systems
サイバーフィジカル系やロボットで頻出する確率計画問題に対し、部分観測・非線形な連続状態行動空間を扱う勾配ベースのオンライン最適化フレームワークを提案し、動力学の近似モデルを事前知識として活用して収束を改善、非凸設定での統一的な収束解析とモデル誤差の影響評価を行い、柔軟梁・四脚歩行ロボットのシミュレーションと卓球ロボットの実機実験で検証した。
著者: Hao Ma, Melanie Zeilinger, Michael Muehlebach
分類: cs.LG, cs.RO
原文アブストラクト
We propose a novel gradient-based online optimization framework for solving stochastic programming problems that frequently arise in the context of cyber-physical and robotic systems. Our problem formulation accommodates constraints that model the evolution of a cyber-physical system, which has, in general, a continuous state and action space, is nonlinear, and where the state is only partially observed. We also incorporate an approximate model of the dynamics as prior knowledge into the learning process and show that even rough estimates of the dynamics can significantly improve the convergence of our algorithms. Our online optimization framework encompasses both gradient descent and quasi-Newton methods, and we provide a unified convergence analysis of our algorithms in a non-convex setting. We also characterize the impact of modeling errors in the system dynamics on the convergence rate of the algorithms. Finally, we evaluate our algorithms in simulations of a flexible beam, a four-legged walking robot, and in real-world experiments with a ping-pong playing robot.
