疎な報酬と疎な相互作用下でのQuality Diversity:ロボット把持への応用
Quality Diversity under Sparse Reward and Sparse Interaction: Application to Grasping in Robotics
報酬と行動が疎な把持タスクにQuality Diversity手法を適用し、15手法を10領域で比較。成功解を優先するMAP-Elites変種が大きく優位であることを示した。
著者: J. Huber, F. Hélénon, M. Coninx, F. Ben Amar, S. Doncieux
分類: cs.RO, cs.LG
原文アブストラクト
Quality-Diversity (QD) methods are algorithms that aim to generate a set of diverse and high-performing solutions to a given problem. Originally developed for evolutionary robotics, most QD studies are conducted on a limited set of domains - mainly applied to locomotion, where the fitness and the behavior signal are dense. Grasping is a crucial task for manipulation in robotics. Despite the efforts of many research communities, this task is yet to be solved. Grasping cumulates unprecedented challenges in QD literature: it suffers from reward sparsity, behavioral sparsity, and behavior space misalignment. The present work studies how QD can address grasping. Experiments have been conducted on 15 different methods on 10 grasping domains, corresponding to 2 different robot-gripper setups and 5 standard objects. An evaluation framework that distinguishes the evaluation of an algorithm from its internal components has also been proposed for a fair comparison. The obtained results show that MAP-Elites variants that select successful solutions in priority outperform all the compared methods on the studied metrics by a large margin. We also found experimental evidence that sparse interaction can lead to deceptive novelty. To our knowledge, the ability to efficiently produce examples of grasping trajectories demonstrated in this work has no precedent in the literature.
関連論文
- 学習済み力学系を用いた協調モバイルマニピュレーションマニピュレーション
- 内視鏡環境におけるMoveItを用いた逆運動学の改善マニピュレーション
- 複数の安定目標を持つ動作プリミティブを模倣学習するmulti-CONDORマニピュレーション
- 制御バリア関数と可変インピーダンス制御による全電動重作業ロボットマニピュレータの安全な物理的相互作用マニピュレーション
- 腕全体で大型物体を持ち上げる把持姿勢を学習するARMFULマニピュレーション
- ReuseMem:ロボットマニピュレーションにおける単一記憶の複数目標への再利用マニピュレーション
