スパースな実演からの目的関数学習:連続ポントリャーギン微分可能プログラミング
Learning from Sparse Demonstrations
ラベル付きキーフレームのみのスパース実演から、ロボットの目的関数と時間ワープ関数を同時に学習するContinuous PDPを提案し、シミュレーションと6自由度クアッドロータで有効性を示した。
著者: Wanxin Jin, Todd D. Murphey, Dana Kulić, Neta Ezer, Shaoshuai Mou
分類: cs.RO, cs.LG, cs.SY, eess.SY
原文アブストラクト
This paper develops the method of Continuous Pontryagin Differentiable Programming (Continuous PDP), which enables a robot to learn an objective function from a few sparsely demonstrated keyframes. The keyframes, labeled with some time stamps, are the desired task-space outputs, which a robot is expected to follow sequentially. The time stamps of the keyframes can be different from the time of the robot's actual execution. The method jointly finds an objective function and a time-warping function such that the robot's resulting trajectory sequentially follows the keyframes with minimal discrepancy loss. The Continuous PDP minimizes the discrepancy loss using projected gradient descent, by efficiently solving the gradient of the robot trajectory with respect to the unknown parameters. The method is first evaluated on a simulated robot arm and then applied to a 6-DoF quadrotor to learn an objective function for motion planning in unmodeled environments. The results show the efficiency of the method, its ability to handle time misalignment between keyframes and robot execution, and the generalization of objective learning into unseen motion conditions.
