タスク指向Koopman制御と対照エンコーダによる高次元非線形システムの操作
Task-Oriented Koopman-Based Control with Contrastive Encoder
強化学習と対照エンコーダを組み合わせ、Koopman潜在表現・演算子・線形制御器を同時学習することで、ピクセル入力やLiDAR観測を伴う高次元複雑系のタスク指向制御を実現した。
著者: Xubo Lyu, Hanyang Hu, Seth Siriya, Ye Pu, Mo Chen
分類: cs.RO, cs.LG, cs.SY, eess.SY
原文アブストラクト
We present task-oriented Koopman-based control that utilizes end-to-end reinforcement learning and contrastive encoder to simultaneously learn the Koopman latent embedding, operator, and associated linear controller within an iterative loop. By prioritizing the task cost as the main objective for controller learning, we reduce the reliance of controller design on a well-identified model, which, for the first time to the best of our knowledge, extends Koopman control from low to high-dimensional, complex nonlinear systems, including pixel-based tasks and a real robot with lidar observations. Code and videos are available \href{https://sites.google.com/view/kpmlilatsupp/}{here}.
