RaggeDi: 拡散モデルによる乱れた布・シーツ・タオル・毛布の状態推定
RaggeDi: Diffusion-based State Estimation of Disordered Rags, Sheets, Towels and Blankets
布の状態推定を画像生成問題として定式化し、拡散モデルで変形メッシュへの並進マップを予測する手法を提案。シミュレーションと実世界で既存手法より高精度・高速に推定できることを示した。
著者: Jikai Ye, Wanze Li, Shiraz Khan, Gregory S. Chirikjian
分類: cs.RO, cs.CV, cs.LG
原文アブストラクト
Cloth state estimation is an important problem in robotics. It is essential for the robot to know the accurate state to manipulate cloth and execute tasks such as robotic dressing, stitching, and covering/uncovering human beings. However, estimating cloth state accurately remains challenging due to its high flexibility and self-occlusion. This paper proposes a diffusion model-based pipeline that formulates the cloth state estimation as an image generation problem by representing the cloth state as an RGB image that describes the point-wise translation (translation map) between a pre-defined flattened mesh and the deformed mesh in a canonical space. Then we train a conditional diffusion-based image generation model to predict the translation map based on an observation. Experiments are conducted in both simulation and the real world to validate the performance of our method. Results indicate that our method outperforms two recent methods in both accuracy and speed.
