SculptDiff: ゴール条件付き拡散方策による人間からのロボット粘土彫刻学習
SculptDiff: Learning Robotic Clay Sculpting from Humans with Goal Conditioned Diffusion Policy
点群を状態として用い、目標形状に応じて粘土を彫刻する操作方策を拡散モデルベースの模倣学習で獲得する手法を提案し、実世界で3D変形物体の操作を学習した初の事例を示した。
著者: Alison Bartsch, Arvind Car, Charlotte Avra, Amir Barati Farimani
分類: cs.RO, cs.AI
原文アブストラクト
Manipulating deformable objects remains a challenge within robotics due to the difficulties of state estimation, long-horizon planning, and predicting how the object will deform given an interaction. These challenges are the most pronounced with 3D deformable objects. We propose SculptDiff, a goal-conditioned diffusion-based imitation learning framework that works with point cloud state observations to directly learn clay sculpting policies for a variety of target shapes. To the best of our knowledge this is the first real-world method that successfully learns manipulation policies for 3D deformable objects. For sculpting videos and access to our dataset and hardware CAD models, see the project website: https://sites.google.com/andrew.cmu.edu/imitation-sculpting/home
