人間のジェスチャーを視覚で模倣するロボットアーム
Vision-based Robotic Arm Imitation by Human Gesture
単眼カメラの映像のみから人間の手の動きを観察し、改良型DDPGと視覚模倣ネットワークを組み合わせてロボットアームに同じ動作を学習・再現させる手法を開発した。
著者: Cheng Xuan, Zhiqiang Tang, Jinxin Xu
分類: cs.RO
原文アブストラクト
One of the most efficient ways for a learning-based robotic arm to learn to process complex tasks as human, is to directly learn from observing how human complete those tasks, and then imitate. Our idea is based on success of Deep Q-Learning (DQN) algorithm according to reinforcement learning, and then extend to Deep Deterministic Policy Gradient (DDPG) algorithm. We developed a learning-based method, combining modified DDPG and visual imitation network. Our approach acquires frames only from a monocular camera, and no need to either construct a 3D environment or generate actual points. The result we expected during training, was that robot would be able to move as almost the same as how human hands did.
