In Search of the Ingredients of Open-Endedness: Replicating Picbreeder with Large Vision-Language Models

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Earle, Sam, Arulkumaran, Kai, Dai, Andrew, Kumar, Akarsh, Togelius, Julian, Risi, Sebastian
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914606415347712
author Earle, Sam
Arulkumaran, Kai
Dai, Andrew
Kumar, Akarsh
Togelius, Julian
Risi, Sebastian
author_facet Earle, Sam
Arulkumaran, Kai
Dai, Andrew
Kumar, Akarsh
Togelius, Julian
Risi, Sebastian
contents We are in the midst of large-scale industrial and academic efforts to automate the processes of scientific, technological and creative production through AI-driven assistants. Historically, a fundamental property of these processes in their human form has been their open-endedness: their capacity for generating a seemingly endless supply of novel and meaningful new forms. Do artificial agents have any capacity for such fruitful unguided discovery? To answer this question, we turn to Picbreeder, the canonical exemplar of human-driven open-ended search, in which users collaboratively generated a diverse library of images through interactive evolution of small neural networks. We replicate Picbreeder, replacing human users with frontier Vision Language Models (VLMs). We observe clear qualitative differences between the output of our system and the historical human baseline, and attempt to characterize them using metrics of phylogenetic complexity and visual and semantic salience and novelty. In an effort to identify some of the causal factors contributing these differences, we study the addition of exploratory noise to the agents' selection process, of behavioral diversity between agents, and of narrative momentum in the form of memory of past actions. We make our code available at https://github.com/smearle/picbreeder-vlm.
format Preprint
id arxiv_https___arxiv_org_abs_2605_23908
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle In Search of the Ingredients of Open-Endedness: Replicating Picbreeder with Large Vision-Language Models
Earle, Sam
Arulkumaran, Kai
Dai, Andrew
Kumar, Akarsh
Togelius, Julian
Risi, Sebastian
Artificial Intelligence
Computation and Language
Computer Vision and Pattern Recognition
Neural and Evolutionary Computing
We are in the midst of large-scale industrial and academic efforts to automate the processes of scientific, technological and creative production through AI-driven assistants. Historically, a fundamental property of these processes in their human form has been their open-endedness: their capacity for generating a seemingly endless supply of novel and meaningful new forms. Do artificial agents have any capacity for such fruitful unguided discovery? To answer this question, we turn to Picbreeder, the canonical exemplar of human-driven open-ended search, in which users collaboratively generated a diverse library of images through interactive evolution of small neural networks. We replicate Picbreeder, replacing human users with frontier Vision Language Models (VLMs). We observe clear qualitative differences between the output of our system and the historical human baseline, and attempt to characterize them using metrics of phylogenetic complexity and visual and semantic salience and novelty. In an effort to identify some of the causal factors contributing these differences, we study the addition of exploratory noise to the agents' selection process, of behavioral diversity between agents, and of narrative momentum in the form of memory of past actions. We make our code available at https://github.com/smearle/picbreeder-vlm.
title In Search of the Ingredients of Open-Endedness: Replicating Picbreeder with Large Vision-Language Models
topic Artificial Intelligence
Computation and Language
Computer Vision and Pattern Recognition
Neural and Evolutionary Computing
url https://arxiv.org/abs/2605.23908