ベクトル量子化エリート:教師なしで問題に依存しない品質多様性最適化
Vector Quantized-Elites: Unsupervised and Problem-Agnostic Quality-Diversity Optimization
VQ-Elitesは、ベクトル量子化変分オートエンコーダを用いて行動空間グリッドを教師なしで構築し、タスクに依存しない品質多様性最適化を実現する手法である。
著者: Constantinos Tsakonas, Konstantinos Chatzilygeroudis
分類: cs.NE, cs.AI, cs.LG, cs.RO
原文アブストラクト
Quality-Diversity algorithms have transformed optimization by prioritizing the discovery of diverse, high-performing solutions over a single optimal result. However, traditional Quality-Diversity methods, such as MAP-Elites, rely heavily on predefined behavior descriptors and complete prior knowledge of the task to define the behavior space grid, limiting their flexibility and applicability. In this work, we introduce Vector Quantized-Elites (VQ-Elites), a novel Quality-Diversity algorithm that autonomously constructs a structured behavior space grid using unsupervised learning, eliminating the need for prior task-specific knowledge. At the core of VQ-Elites is the integration of Vector Quantized Variational Autoencoders, which enables the dynamic learning of behavior descriptors and the generation of a structured, rather than unstructured, behavior space grid -- a significant advancement over existing unsupervised Quality-Diversity approaches. This design establishes VQ-Elites as a flexible, robust, and task-agnostic optimization framework. To further enhance the performance of unsupervised Quality-Diversity algorithms, we introduce behavior space bounding and cooperation mechanisms, which significantly improve convergence and performance, as well as the Effective Diversity Ratio and Coverage Diversity Score, two novel metrics that quantify the actual diversity in the unsupervised setting. We validate VQ-Elites on robotic arm pose-reaching, mobile robot space-covering, and MiniGrid exploration tasks. The results demonstrate its ability to efficiently generate diverse, high-quality solutions, emphasizing its adaptability, scalability, robustness to hyperparameters, and potential to extend Quality-Diversity optimization to complex, previously inaccessible domains.
関連論文
- 運任せは禁物:不確実な領域における品質多様性解の再現性向上品質多様性最適化
- MAP-Elitesを複数の並列進化戦略で強化する品質多様性最適化
- 大規模並列化による品質多様性最適化の高速化品質多様性最適化
