Detail++: Training-Free Detail Enhancer for Text-to-Image Diffusion Models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chen, Lifeng, Wang, Jiner, Pan, Zihao, Zhu, Beier, Yang, Xiaofeng, Zhang, Chi
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911073936867328
author Chen, Lifeng
Wang, Jiner
Pan, Zihao
Zhu, Beier
Yang, Xiaofeng
Zhang, Chi
author_facet Chen, Lifeng
Wang, Jiner
Pan, Zihao
Zhu, Beier
Yang, Xiaofeng
Zhang, Chi
contents Recent advances in text-to-image (T2I) generation have led to impressive visual results. However, these models still face significant challenges when handling complex prompt, particularly those involving multiple subjects with distinct attributes. Inspired by the human drawing process, which first outlines the composition and then incrementally adds details, we propose Detail++, a training-free framework that introduces a novel Progressive Detail Injection (PDI) strategy to address this limitation. Specifically, we decompose a complex prompt into a sequence of simplified sub-prompts, guiding the generation process in stages. This staged generation leverages the inherent layout-controlling capacity of self-attention to first ensure global composition, followed by precise refinement. To achieve accurate binding between attributes and corresponding subjects, we exploit cross-attention mechanisms and further introduce a Centroid Alignment Loss at test time to reduce binding noise and enhance attribute consistency. Extensive experiments on T2I-CompBench and a newly constructed style composition benchmark demonstrate that Detail++ significantly outperforms existing methods, particularly in scenarios involving multiple objects and complex stylistic conditions.
format Preprint
id arxiv_https___arxiv_org_abs_2507_17853
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Detail++: Training-Free Detail Enhancer for Text-to-Image Diffusion Models
Chen, Lifeng
Wang, Jiner
Pan, Zihao
Zhu, Beier
Yang, Xiaofeng
Zhang, Chi
Computer Vision and Pattern Recognition
Artificial Intelligence
Recent advances in text-to-image (T2I) generation have led to impressive visual results. However, these models still face significant challenges when handling complex prompt, particularly those involving multiple subjects with distinct attributes. Inspired by the human drawing process, which first outlines the composition and then incrementally adds details, we propose Detail++, a training-free framework that introduces a novel Progressive Detail Injection (PDI) strategy to address this limitation. Specifically, we decompose a complex prompt into a sequence of simplified sub-prompts, guiding the generation process in stages. This staged generation leverages the inherent layout-controlling capacity of self-attention to first ensure global composition, followed by precise refinement. To achieve accurate binding between attributes and corresponding subjects, we exploit cross-attention mechanisms and further introduce a Centroid Alignment Loss at test time to reduce binding noise and enhance attribute consistency. Extensive experiments on T2I-CompBench and a newly constructed style composition benchmark demonstrate that Detail++ significantly outperforms existing methods, particularly in scenarios involving multiple objects and complex stylistic conditions.
title Detail++: Training-Free Detail Enhancer for Text-to-Image Diffusion Models
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2507.17853