DiSPo: 拡散状態空間モデルによる粗から細への行動離散化ポリシー学習
DiSPo: Diffusion-SSM based Policy Learning for Coarse-to-Fine Action Discretization
拡散モデルと状態空間モデルMambaを組み合わせ、粗いスキルから細かい制御まで段階的に行動を生成するポリシー学習手法を提案し、模倣学習の精度と推論効率を向上させた。
著者: Nayoung Oh, Jaehyeong Jang, Moonkyeong Jung, Daehyung Park
分類: cs.RO
原文アブストラクト
We aim to solve the problem of generating coarse-to-fine skills learning from demonstrations (LfD). To scale precision, traditional LfD approaches often rely on extensive fine-grained demonstrations with external interpolations or dynamics models with limited generalization capabilities. For memory-efficient learning and convenient granularity change, we propose a novel diffusion-state space model (SSM) based policy (DiSPo) that learns from diverse coarse skills and produces varying control scales of actions by leveraging an SSM, Mamba. Our evaluations show the adoption of Mamba and the proposed step-scaling method enable DiSPo to outperform in three coarse-to-fine benchmark tests with maximum 81% higher success rate than baselines. In addition, DiSPo improves inference efficiency by generating coarse motions in less critical regions. We finally demonstrate the scalability of actions with simulation and real-world manipulation tasks. Code and Videos are available at https://robo-dispo.github.io.
