対応志向模倣学習:3D条件付けによる柔軟な視覚運動制御
Correspondence-Oriented Imitation Learning: Flexible Visuomotor Control with 3D Conditioning
物体上のキーポイントの動きでタスクを指定し、可変な時空間粒度の指示に適応する条件付き模倣学習フレームワークを提案。実世界のマニピュレーションで従来手法を上回る性能を示した。
詳しい要約
1. どんなもの?
2. 先行研究と比べてどこがすごい?
3. 技術・手法の肝は?
4. どうやって有効だと検証した?
5. 議論はある?
6. 次に読むべき論文は?
※ AIが要旨から生成した要約です。正確性は原文をご確認ください。
著者: Yunhao Cao, Zubin Bhaumik, Jessie Jia, Xingyi He, Kuan Fang
分類: cs.RO
原文アブストラクト
We introduce Correspondence-Oriented Imitation Learning (COIL), a conditional policy learning framework for visuomotor control with a flexible task representation in 3D. At the core of our approach, each task is defined by the intended motion of keypoints selected on objects in the scene. Instead of assuming a fixed number of keypoints or uniformly spaced time intervals, COIL supports task specifications with variable spatial and temporal granularity, adapting to different user intents and task requirements. To robustly ground this correspondence-oriented task representation into actions, we design a conditional policy with a spatio-temporal attention mechanism that effectively fuses information across multiple input modalities. The policy is trained via a scalable self-supervised pipeline using demonstrations collected in simulation, with correspondence labels automatically generated in hindsight. COIL generalizes across tasks, objects, and motion patterns, achieving superior performance compared to prior methods on real-world manipulation tasks under both sparse and dense specifications.
