状態レベルの軌道スティッチングによるロバストなオフライン模倣学習
Robust Offline Imitation Learning Through State-level Trajectory Stitching
混合品質のオフラインデータから、状態ベースの探索で軌道断片を繋ぎ合わせ、多様で有益な訓練軌道を生成することで、模倣学習の汎化性能と成功率を向上させる手法を提案。
著者: Shuze Wang, Yunpeng Mei, Hongjie Cao, Yetian Yuan, Gang Wang, Jian Sun, Jie Chen
分類: cs.RO, cs.AI
原文アブストラクト
Imitation learning (IL) has proven effective for enabling robots to acquire visuomotor skills through expert demonstrations. However, traditional IL methods are limited by their reliance on high-quality, often scarce, expert data, and suffer from covariate shift. To address these challenges, recent advances in offline IL have incorporated suboptimal, unlabeled datasets into the training. In this paper, we propose a novel approach to enhance policy learning from mixed-quality offline datasets by leveraging task-relevant trajectory fragments and rich environmental dynamics. Specifically, we introduce a state-based search framework that stitches state-action pairs from imperfect demonstrations, generating more diverse and informative training trajectories. Experimental results on standard IL benchmarks and real-world robotic tasks showcase that our proposed method significantly improves both generalization and performance.
