関連性誘導による能力の教師なし発見:品質多様性アルゴリズム
Relevance-guided Unsupervised Discovery of Abilities with Quality-Diversity Algorithms
手動設計の行動記述子を必要とせず、タスクに適した行動特徴を自律的に学習する品質多様性アルゴリズムを提案し、ロボットのシミュレーション環境で有効性を示した。
著者: Luca Grillotti, Antoine Cully
分類: cs.NE, cs.AI, cs.LG, cs.RO
原文アブストラクト
Quality-Diversity algorithms provide efficient mechanisms to generate large collections of diverse and high-performing solutions, which have shown to be instrumental for solving downstream tasks. However, most of those algorithms rely on a behavioural descriptor to characterise the diversity that is hand-coded, hence requiring prior knowledge about the considered tasks. In this work, we introduce Relevance-guided Unsupervised Discovery of Abilities; a Quality-Diversity algorithm that autonomously finds a behavioural characterisation tailored to the task at hand. In particular, our method introduces a custom diversity metric that leads to higher densities of solutions near the areas of interest in the learnt behavioural descriptor space. We evaluate our approach on a simulated robotic environment, where the robot has to autonomously discover its abilities based on its full sensory data. We evaluated the algorithms on three tasks: navigation to random targets, moving forward with a high velocity, and performing half-rolls. The experimental results show that our method manages to discover collections of solutions that are not only diverse, but also well-adapted to the considered downstream task.
関連論文
- 教師なし行動発見のための品質多様性最適化品質多様性
