セット教師付き拡散ポリシー:修正を通じたアクションチャンク拡散の学習
Set-Supervised Diffusion Policy: Learning Action-Chunking Diffusion through Corrections
ロボットの望ましくない動作と人間の修正動作のペアを利用し、拡散ポリシーを望ましいアクションチャンクのセットに整列させる新しい学習フレームワークを提案。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Zhaoting Li, Gang Chen, Javier Alonso-Mora, Cosimo Della Santina, Jens Kober
分類: cs.RO
原文アブストラクト
Diffusion policies have recently emerged as a powerful framework for robotic manipulation. However, like other behavior cloning methods, they remain vulnerable to distributional shift, often requiring human-in-the-loop interventions to correct failures during deployment. These interactions naturally provide paired supervision in the form of the robot's undesired actions and the human teacher's corrective actions. Yet existing data aggregation pipelines and standard behavior cloning losses largely ignore this negative signal from undesired actions, leading to overfitting to teacher's actions and an increasing reliance on costly expert data. To address this limitation, we propose Set-Supervised Diffusion Policy (SDP), a novel learning framework that utilizes contrastive action-chunk data to train diffusion policies from human corrections. From paired positive and negative action-chunks, SDP constructs a set of desired action-chunks and designs a training pipeline that encourages the diffusion policy to align with the set. Through extensive experiments across multiple robotic manipulation tasks, we demonstrate that SDP consistently improves policy performance, with particularly strong gains in robustness to noisy data. Moreover, SDP induces high-quality aggregated datasets, enabling more efficient and reliable policy learning from human-in-the-loop corrections. Our code is available at https://set-supervised-diffusion-policy.github.io/.
関連論文
- 空間条件付き拡散ポリシー:単一RGBカメラによる精密で堅牢な操作学習模倣学習/拡散ポリシー
- 効率的なタスク特化型条件付き拡散ポリシー:ショートカットモデルによる加速とSO(3)最適化模倣学習/拡散ポリシー
- 変調トランスフォーマーに基づく拡散ポリシーモデルMTDP模倣学習/拡散ポリシー
- マルチタスク学習のための専門家混合デノイザーを用いた効率的拡散トランスフォーマーポリシー模倣学習/拡散ポリシー
