潜在フィードバック制御器の切り替えによるスキル獲得の確率的モデル
A Probabilistic Model for Skill Acquisition with Switching Latent Feedback Controllers
混合密度ネットワークを潜在状態に条件付けられたフィードバック制御器のライブラリとして再解釈し、スキル獲得を潜在空間のセグメンテーションとして捉える確率的グラフィカルモデルを提案。人間のデモンストレーションから学習し、タスク成功率と観測ノイズへの頑健性を向上させ、実機ロボットでの展開も示した。
著者: Juyan Zhang, Dana Kulic, Michael Burke
分類: cs.RO
原文アブストラクト
Manipulation tasks often consist of subtasks, each representing a distinct skill. Mastering these skills is essential for robots, as it enhances their autonomy, efficiency, adaptability, and ability to work in their environment. Learning from demonstrations allows robots to rapidly acquire new skills without starting from scratch, with demonstrations typically sequencing skills to achieve tasks. Behaviour cloning approaches to learning from demonstration commonly rely on mixture density network output heads to predict robot actions. In this work, we first reinterpret the mixture density network as a library of feedback controllers (or skills) conditioned on latent states. This arises from the observation that a one-layer linear network is functionally equivalent to a classical feedback controller, with network weights corresponding to controller gains. We use this insight to derive a probabilistic graphical model that combines these elements, describing the skill acquisition process as segmentation in a latent space, where each skill policy functions as a feedback control law in this latent space. Our approach significantly improves not only task success rate, but also robustness to observation noise when trained with human demonstrations. Our physical robot experiments further show that the induced robustness improves model deployment on robots.
