大域的に安定なニューラル模倣ポリシー
Globally Stable Neural Imitation Policies
リアプノフの定理に基づく安定性保証付きの模倣学習手法SNDSを提案し、シミュレーションと実機マニピュレータで従来法の不安定性・精度・計算負荷の問題を克服できることを示した。
著者: Amin Abyaneh, Mariana Sosa Guzmán, Hsiu-Chin Lin
分類: cs.RO, cs.LG
原文アブストラクト
Imitation learning presents an effective approach to alleviate the resource-intensive and time-consuming nature of policy learning from scratch in the solution space. Even though the resulting policy can mimic expert demonstrations reliably, it often lacks predictability in unexplored regions of the state-space, giving rise to significant safety concerns in the face of perturbations. To address these challenges, we introduce the Stable Neural Dynamical System (SNDS), an imitation learning regime which produces a policy with formal stability guarantees. We deploy a neural policy architecture that facilitates the representation of stability based on Lyapunov theorem, and jointly train the policy and its corresponding Lyapunov candidate to ensure global stability. We validate our approach by conducting extensive experiments in simulation and successfully deploying the trained policies on a real-world manipulator arm. The experimental results demonstrate that our method overcomes the instability, accuracy, and computational intensity problems associated with previous imitation learning methods, making our method a promising solution for stable policy learning in complex planning scenarios.
