Training-Free Constrained Generation With Stable Diffusion Models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zampini, Stefano, Christopher, Jacob K., Oneto, Luca, Anguita, Davide, Fioretto, Ferdinando
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917033084452864
author Zampini, Stefano
Christopher, Jacob K.
Oneto, Luca
Anguita, Davide
Fioretto, Ferdinando
author_facet Zampini, Stefano
Christopher, Jacob K.
Oneto, Luca
Anguita, Davide
Fioretto, Ferdinando
contents Stable diffusion models represent the state-of-the-art in data synthesis across diverse domains and hold transformative potential for applications in science and engineering, e.g., by facilitating the discovery of novel solutions and simulating systems that are computationally intractable to model explicitly. While there is increasing effort to incorporate physics-based constraints into generative models, existing techniques are either limited in their applicability to latent diffusion frameworks or lack the capability to strictly enforce domain-specific constraints. To address this limitation this paper proposes a novel integration of stable diffusion models with constrained optimization frameworks, enabling the generation of outputs satisfying stringent physical and functional requirements. The effectiveness of this approach is demonstrated through material design experiments requiring adherence to precise morphometric properties, challenging inverse design tasks involving the generation of materials inducing specific stress-strain responses, and copyright-constrained content generation tasks. All code has been released at https://github.com/RAISELab-atUVA/Constrained-Stable-Diffusion.
format Preprint
id arxiv_https___arxiv_org_abs_2502_05625
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Training-Free Constrained Generation With Stable Diffusion Models
Zampini, Stefano
Christopher, Jacob K.
Oneto, Luca
Anguita, Davide
Fioretto, Ferdinando
Machine Learning
Stable diffusion models represent the state-of-the-art in data synthesis across diverse domains and hold transformative potential for applications in science and engineering, e.g., by facilitating the discovery of novel solutions and simulating systems that are computationally intractable to model explicitly. While there is increasing effort to incorporate physics-based constraints into generative models, existing techniques are either limited in their applicability to latent diffusion frameworks or lack the capability to strictly enforce domain-specific constraints. To address this limitation this paper proposes a novel integration of stable diffusion models with constrained optimization frameworks, enabling the generation of outputs satisfying stringent physical and functional requirements. The effectiveness of this approach is demonstrated through material design experiments requiring adherence to precise morphometric properties, challenging inverse design tasks involving the generation of materials inducing specific stress-strain responses, and copyright-constrained content generation tasks. All code has been released at https://github.com/RAISELab-atUVA/Constrained-Stable-Diffusion.
title Training-Free Constrained Generation With Stable Diffusion Models
topic Machine Learning
url https://arxiv.org/abs/2502.05625