MAP-Elitesを複数の並列進化戦略で強化する
Enhancing MAP-Elites with Multiple Parallel Evolution Strategies
品質多様性アルゴリズムMAP-Elitesに複数の進化戦略プロセスを並列に組み込み、単一GPU上で大規模並列評価を活用して高性能かつ多様な解を生成する手法を提案。
著者: Manon Flageat, Bryan Lim, Antoine Cully
分類: cs.NE, cs.AI, cs.LG, cs.RO
原文アブストラクト
With the development of fast and massively parallel evaluations in many domains, Quality-Diversity (QD) algorithms, that already proved promising in a large range of applications, have seen their potential multiplied. However, we have yet to understand how to best use a large number of evaluations as using them for random variations alone is not always effective. High-dimensional search spaces are a typical situation where random variations struggle to effectively search. Another situation is uncertain settings where solutions can appear better than they truly are and naively evaluating more solutions might mislead QD algorithms. In this work, we propose MAP-Elites-Multi-ES (MEMES), a novel QD algorithm based on Evolution Strategies (ES) designed to exploit fast parallel evaluations more effectively. MEMES maintains multiple (up to 100) simultaneous ES processes, each with its own independent objective and reset mechanism designed for QD optimisation, all on just a single GPU. We show that MEMES outperforms both gradient-based and mutation-based QD algorithms on black-box optimisation and QD-Reinforcement-Learning tasks, demonstrating its benefit across domains. Additionally, our approach outperforms sampling-based QD methods in uncertain domains when given the same evaluation budget. Overall, MEMES generates reproducible solutions that are high-performing and diverse through large-scale ES optimisation on easily accessible hardware.
関連論文
- ベクトル量子化エリート:教師なしで問題に依存しない品質多様性最適化品質多様性最適化
- 運任せは禁物:不確実な領域における品質多様性解の再現性向上品質多様性最適化
- 大規模並列化による品質多様性最適化の高速化品質多様性最適化
