視覚駆動型変形可能線状物体操作のための物体中心エージェント適応におけるReal2Sim2Realの分布的アプローチ
A Distributional Treatment of Real2Sim2Real for Object-Centric Agent Adaptation in Vision-Driven Deformable Linear Object Manipulation
変形可能線状物体(DLO)の操作において、尤度フリー推論で物理パラメータの事後分布を推定し、ドメインランダム化を用いたシミュレーション訓練で物体固有の視覚運動ポリシーを学習、実世界でゼロショット展開する統合フレームワークを提案。
著者: Georgios Kamaras, Subramanian Ramamoorthy
分類: cs.RO, cs.LG
原文アブストラクト
We present an integrated (or end-to-end) framework for the Real2Sim2Real problem of manipulating deformable linear objects (DLOs) based on visual perception. Working with a parameterised set of DLOs, we use likelihood-free inference (LFI) to compute the posterior distributions for the physical parameters using which we can approximately simulate the behaviour of each specific DLO. We use these posteriors for domain randomisation while training, in simulation, object-specific visuomotor policies (i.e. assuming only visual and proprioceptive sensory) for a DLO reaching task, using model-free reinforcement learning. We demonstrate the utility of this approach by deploying sim-trained DLO manipulation policies in the real world in a zero-shot manner, i.e. without any further fine-tuning. In this context, we evaluate the capacity of a prominent LFI method to perform fine classification over the parametric set of DLOs, using only visual and proprioceptive data obtained in a dynamic manipulation trajectory. We then study the implications of the resulting domain distributions in sim-based policy learning and real-world performance.
