CORE: 行動ラベルなし視覚デモからロボット操作の共通結果規則性を抽出する手法
CORE: Common Outcome Regularities from Action-Free Visual Demonstrations for Robot Manipulation
ロボット操作の模倣学習において、高コストなロボットデモの代わりに、人間の動画などの行動ラベルなし視覚デモを活用するため、タスク成功時の終端状態の共通規則性を学習し、それを視覚的な目標プロトタイプとしてポリシーに組み込むCOREを提案した。
詳しい要約
1. どんなもの？
2. 先行研究と比べてどこがすごい？
3. 技術・手法の肝は？
4. どうやって有効だと検証した？
5. 議論はある？
6. 次に読むべき論文は？
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Juyi Sheng, Mingxin Tan, Jincheng Li, Mengyuan Liu
分類: cs.RO
原文アブストラクト
Robot imitation learning often relies on costly robot demonstrations, while abundant action-free visual demonstrations, such as human videos, are difficult to use because they lack robot-executable actions and suffer from embodiment gaps. We propose CORE, a policy learning framework that extracts Common Outcome Regularities (CORE) from visual demonstrations. Rather than transferring explicit actions across embodiments, CORE exploits a key observation: although successful trajectories for the same task can be diverse, their terminal states often share stable object configurations, spatial relations, and contact constraints. CORE first trains a terminal outcome encoder with contrastive and auxiliary temporal objectives, then aggregates successful terminal embeddings into visual goal prototypes, and finally injects these prototypes as global goal conditions into robot policies. Compared with language instructions, visual goal prototypes provide more concrete geometric and physical constraints for task completion. Across Meta-World, RoboTwin 2.0, and real-world manipulation, CORE improves the average success rate of the corresponding policy backbones by up to +3.9, +11.1, and +17.0 percentage points, respectively, and outperforms text-conditioned variants under the evaluated settings. The project and code are available at https://logssim.github.io/CORE.github.io/.
