変形可能な線状物体の形状制御のためのオフライン目標条件付き強化学習
Offline Goal-Conditioned Reinforcement Learning for Shape Control of Deformable Linear Objects
柔らかいロープや弾性コードのような変形可能な線状物体の平面形状制御を、オフライン強化学習(目標条件付き)で解き、形状サーボ法を上回る性能を示した。
著者: Rita Laezza, Mohammadreza Shetab-Bushehri, Gabriel Arslan Waltersson, Erol Özgür, Youcef Mezouar, Yiannis Karayiannidis
分類: cs.RO, cs.SY, eess.SY
原文アブストラクト
Deformable objects present several challenges to the field of robotic manipulation. One of the tasks that best encapsulates the difficulties arising due to non-rigid behavior is shape control, which requires driving an object to a desired shape. While shape-servoing methods have been shown successful in contexts with approximately linear behavior, they can fail in tasks with more complex dynamics. We investigate an alternative approach, using offline RL to solve a planar shape control problem of a Deformable Linear Object (DLO). To evaluate the effect of material properties, two DLOs are tested namely a soft rope and an elastic cord. We frame this task as a goal-conditioned offline RL problem, and aim to learn to generalize to unseen goal shapes. Data collection and augmentation procedures are proposed to limit the amount of experimental data which needs to be collected with the real robot. We evaluate the amount of augmentation needed to achieve the best results, and test the effect of regularization through behavior cloning on the TD3+BC algorithm. Finally, we show that the proposed approach is able to outperform a shape-servoing baseline in a curvature inversion experiment.
関連論文
- 変形可能な線状物体のキーポイント位置決めに対する強化学習の実証研究変形物体マニピュレーション
- 自律マニピュレーションのためのライブ糸再構成変形物体マニピュレーション
- ClothAtlas: 自己遮蔽下での衣服の同定と状態推定の同時実行変形物体マニピュレーション
- 狙って叩け:方向条件付き変形可能線状物体の動的マニピュレーション変形物体マニピュレーション
- FoldNet++:ロボットによるTシャツ折り畳み・展開のための大規模合成データセット変形物体マニピュレーション
- 非無視可能なダイナミクスを持つ変形可能な線状物体の自己教師あり物理情報マニピュレーション変形物体マニピュレーション
