Discovering Quality-Diversity Algorithms via Meta-Black-Box Optimization

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Faldor, Maxence, Lange, Robert Tjarko, Cully, Antoine
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916597322481664
author Faldor, Maxence
Lange, Robert Tjarko
Cully, Antoine
author_facet Faldor, Maxence
Lange, Robert Tjarko
Cully, Antoine
contents Quality-Diversity has emerged as a powerful family of evolutionary algorithms that generate diverse populations of high-performing solutions by implementing local competition principles inspired by biological evolution. While these algorithms successfully foster diversity and innovation, their specific mechanisms rely on heuristics, such as grid-based competition in MAP-Elites or nearest-neighbor competition in unstructured archives. In this work, we propose a fundamentally different approach: using meta-learning to automatically discover novel Quality-Diversity algorithms. By parameterizing the competition rules using attention-based neural architectures, we evolve new algorithms that capture complex relationships between individuals in the descriptor space. Our discovered algorithms demonstrate competitive or superior performance compared to established Quality-Diversity baselines while exhibiting strong generalization to higher dimensions, larger populations, and out-of-distribution domains like robot control. Notably, even when optimized solely for fitness, these algorithms naturally maintain diverse populations, suggesting meta-learning rediscovers that diversity is fundamental to effective optimization.
format Preprint
id arxiv_https___arxiv_org_abs_2502_02190
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Discovering Quality-Diversity Algorithms via Meta-Black-Box Optimization
Faldor, Maxence
Lange, Robert Tjarko
Cully, Antoine
Neural and Evolutionary Computing
Machine Learning
Quality-Diversity has emerged as a powerful family of evolutionary algorithms that generate diverse populations of high-performing solutions by implementing local competition principles inspired by biological evolution. While these algorithms successfully foster diversity and innovation, their specific mechanisms rely on heuristics, such as grid-based competition in MAP-Elites or nearest-neighbor competition in unstructured archives. In this work, we propose a fundamentally different approach: using meta-learning to automatically discover novel Quality-Diversity algorithms. By parameterizing the competition rules using attention-based neural architectures, we evolve new algorithms that capture complex relationships between individuals in the descriptor space. Our discovered algorithms demonstrate competitive or superior performance compared to established Quality-Diversity baselines while exhibiting strong generalization to higher dimensions, larger populations, and out-of-distribution domains like robot control. Notably, even when optimized solely for fitness, these algorithms naturally maintain diverse populations, suggesting meta-learning rediscovers that diversity is fundamental to effective optimization.
title Discovering Quality-Diversity Algorithms via Meta-Black-Box Optimization
topic Neural and Evolutionary Computing
Machine Learning
url https://arxiv.org/abs/2502.02190