触覚に基づく内的動機付けによるロボットマニピュレーション学習の改善
Improved Learning of Robot Manipulation Tasks via Tactile Intrinsic Motivation
ロボットの力覚センサと物体間の力の総和を内的報酬として用い、接触の多い経験を優先的に再生する手法を導入し、強化学習における探索を加速させて3つの操作ベンチマークで従来手法を上回った。
著者: Nikola Vulin, Sammy Christen, Stefan Stevsic, Otmar Hilliges
分類: cs.RO, cs.AI, cs.LG
原文アブストラクト
In this paper we address the challenge of exploration in deep reinforcement learning for robotic manipulation tasks. In sparse goal settings, an agent does not receive any positive feedback until randomly achieving the goal, which becomes infeasible for longer control sequences. Inspired by touch-based exploration observed in children, we formulate an intrinsic reward based on the sum of forces between a robot's force sensors and manipulation objects that encourages physical interaction. Furthermore, we introduce contact-prioritized experience replay, a sampling scheme that prioritizes contact rich episodes and transitions. We show that our solution accelerates the exploration and outperforms state-of-the-art methods on three fundamental robot manipulation benchmarks.
