幾何学的視点による視覚模倣学習
A Geometric Perspective on Visual Imitation Learning
人間の教示や強化学習環境なしに、実演動画から幾何学的に一貫した特徴対応規則を推論し、ロボットの低レベル動作へ効率的に変換する視覚模倣学習手法を提案した。
著者: Jun Jin, Laura Petrich, Masood Dehghan, Martin Jagersand
分類: cs.RO, cs.LG
原文アブストラクト
We consider the problem of visual imitation learning without human supervision (e.g. kinesthetic teaching or teleoperation), nor access to an interactive reinforcement learning (RL) training environment. We present a geometric perspective to derive solutions to this problem. Specifically, we propose VGS-IL (Visual Geometric Skill Imitation Learning), an end-to-end geometry-parameterized task concept inference method, to infer globally consistent geometric feature association rules from human demonstration video frames. We show that, instead of learning actions from image pixels, learning a geometry-parameterized task concept provides an explainable and invariant representation across demonstrator to imitator under various environmental settings. Moreover, such a task concept representation provides a direct link with geometric vision based controllers (e.g. visual servoing), allowing for efficient mapping of high-level task concepts to low-level robot actions.
