不正確な知覚シミュレーションを伴うデータ駆動型ポリシー転送
Data-driven Policy Transfer with Imprecise Perception Simulation
非微分可能な物理シミュレータと複雑な状態推定を扱うため、生成モデルでシミュレータ出力を補正しつつ、粗から細への学習で実機にポリシーを転送する手法を提案した。
著者: Martin Pecka, Karel Zimmermann, Matěj Petrlík, Tomáš Svoboda
分類: cs.RO
原文アブストラクト
The paper presents a complete pipeline for learning continuous motion control policies for a mobile robot when only a non-differentiable physics simulator of robot-terrain interactions is available. The multi-modal state estimation of the robot is also complex and difficult to simulate, so we simultaneously learn a generative model which refines simulator outputs. We propose a coarse-to-fine learning paradigm, where the coarse motion planning is alternated with imitation learning and policy transfer to the real robot. The policy is jointly optimized with the generative model. We evaluate the method on a real-world platform in a batch of experiments.
