Generative Design through Quality-Diversity Data Synthesis and Language Models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Gaier, Adam, Stoddart, James, Villaggi, Lorenzo, Sudhakaran, Shyam
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913352724250624
author Gaier, Adam
Stoddart, James
Villaggi, Lorenzo
Sudhakaran, Shyam
author_facet Gaier, Adam
Stoddart, James
Villaggi, Lorenzo
Sudhakaran, Shyam
contents Two fundamental challenges face generative models in engineering applications: the acquisition of high-performing, diverse datasets, and the adherence to precise constraints in generated designs. We propose a novel approach combining optimization, constraint satisfaction, and language models to tackle these challenges in architectural design. Our method uses Quality-Diversity (QD) to generate a diverse, high-performing dataset. We then fine-tune a language model with this dataset to generate high-level designs. These designs are then refined into detailed, constraint-compliant layouts using the Wave Function Collapse algorithm. Our system demonstrates reliable adherence to textual guidance, enabling the generation of layouts with targeted architectural and performance features. Crucially, our results indicate that data synthesized through the evolutionary search of QD not only improves overall model performance but is essential for the model's ability to closely adhere to textual guidance. This improvement underscores the pivotal role evolutionary computation can play in creating the datasets key to training generative models for design. Web article at https://tilegpt.github.io
format Preprint
id arxiv_https___arxiv_org_abs_2405_09997
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Generative Design through Quality-Diversity Data Synthesis and Language Models
Gaier, Adam
Stoddart, James
Villaggi, Lorenzo
Sudhakaran, Shyam
Neural and Evolutionary Computing
Machine Learning
Two fundamental challenges face generative models in engineering applications: the acquisition of high-performing, diverse datasets, and the adherence to precise constraints in generated designs. We propose a novel approach combining optimization, constraint satisfaction, and language models to tackle these challenges in architectural design. Our method uses Quality-Diversity (QD) to generate a diverse, high-performing dataset. We then fine-tune a language model with this dataset to generate high-level designs. These designs are then refined into detailed, constraint-compliant layouts using the Wave Function Collapse algorithm. Our system demonstrates reliable adherence to textual guidance, enabling the generation of layouts with targeted architectural and performance features. Crucially, our results indicate that data synthesized through the evolutionary search of QD not only improves overall model performance but is essential for the model's ability to closely adhere to textual guidance. This improvement underscores the pivotal role evolutionary computation can play in creating the datasets key to training generative models for design. Web article at https://tilegpt.github.io
title Generative Design through Quality-Diversity Data Synthesis and Language Models
topic Neural and Evolutionary Computing
Machine Learning
url https://arxiv.org/abs/2405.09997