編み物ロボット:深層学習による布地パターンの逆解析手法
Knitting Robots: A Deep Learning Approach for Reverse-Engineering Fabric Patterns
布地画像から編み目パターンを深層学習で推定し、ロボットが編み機を自動制御できるようにする二段階パイプラインを提案した研究。
著者: Haoliang Sheng, Songpu Cai, Xingyu Zheng, Meng Cheng Lau
分類: cs.RO, cs.LG
原文アブストラクト
Knitting, a cornerstone of textile manufacturing, is uniquely challenging to automate, particularly in terms of converting fabric designs into precise, machine-readable instructions. This research bridges the gap between textile production and robotic automation by proposing a novel deep learning-based pipeline for reverse knitting to integrate vision-based robotic systems into textile manufacturing. The pipeline employs a two-stage architecture, enabling robots to first identify front labels before inferring complete labels, ensuring accurate, scalable pattern generation. By incorporating diverse yarn structures, including single-yarn (sj) and multi-yarn (mj) patterns, this study demonstrates how our system can adapt to varying material complexities. Critical challenges in robotic textile manipulation, such as label imbalance, underrepresented stitch types, and the need for fine-grained control, are addressed by leveraging specialized deep-learning architectures. This work establishes a foundation for fully automated robotic knitting systems, enabling customizable, flexible production processes that integrate perception, planning, and actuation, thereby advancing textile manufacturing through intelligent robotic automation.
関連論文
- Curie's Jarvis:印刷プロトコルからの自律ロボット化学実験ロボットマニピュレーション
- OMAR: 未知物体を推論して棚を整理するオープンワールド多属性推論ロボットマニピュレーション
- HiL-ResRL: 人間参加型残差強化学習によるモデル非依存のファインチューニングアダプタロボットマニピュレーション
- 軌道最適化に導かれた敵対的正則化ポリシー学習ロボットマニピュレーション
