SplitFlux: Learning to Decouple Content and Style from a Single Image

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yang, Yitong, Wang, Yinglin, Wang, Changshuo, Zhang, Yongjun, Chen, Ziyang, He, Shuting
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914172254552064
author Yang, Yitong
Wang, Yinglin
Wang, Changshuo
Zhang, Yongjun
Chen, Ziyang
He, Shuting
author_facet Yang, Yitong
Wang, Yinglin
Wang, Changshuo
Zhang, Yongjun
Chen, Ziyang
He, Shuting
contents Disentangling image content and style is essential for customized image generation. Existing SDXL-based methods struggle to achieve high-quality results, while the recently proposed Flux model fails to achieve effective content-style separation due to its underexplored characteristics. To address these challenges, we conduct a systematic analysis of Flux and make two key observations: (1) Single Stream Blocks are essential for image generation; and (2) Early single stream blocks mainly control content, whereas later blocks govern style. Based on these insights, we propose SplitFlux, which disentangles content and style by fine-tuning the single stream blocks via LoRA, enabling the disentangled content to be re-embedded into new contexts. It includes two key components: (1) Rank-Constrained Adaptation. To preserve content identity and structure, we compress the rank and amplify the magnitude of updates within specific blocks, preventing content leakage into style blocks. (2) Visual-Gated LoRA. We split the content LoRA into two branches with different ranks, guided by image saliency. The high-rank branch preserves primary subject information, while the low-rank branch encodes residual details, mitigating content overfitting and enabling seamless re-embedding. Extensive experiments demonstrate that SplitFlux consistently outperforms state-of-the-art methods, achieving superior content preservation and stylization quality across diverse scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2511_15258
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SplitFlux: Learning to Decouple Content and Style from a Single Image
Yang, Yitong
Wang, Yinglin
Wang, Changshuo
Zhang, Yongjun
Chen, Ziyang
He, Shuting
Computer Vision and Pattern Recognition
Disentangling image content and style is essential for customized image generation. Existing SDXL-based methods struggle to achieve high-quality results, while the recently proposed Flux model fails to achieve effective content-style separation due to its underexplored characteristics. To address these challenges, we conduct a systematic analysis of Flux and make two key observations: (1) Single Stream Blocks are essential for image generation; and (2) Early single stream blocks mainly control content, whereas later blocks govern style. Based on these insights, we propose SplitFlux, which disentangles content and style by fine-tuning the single stream blocks via LoRA, enabling the disentangled content to be re-embedded into new contexts. It includes two key components: (1) Rank-Constrained Adaptation. To preserve content identity and structure, we compress the rank and amplify the magnitude of updates within specific blocks, preventing content leakage into style blocks. (2) Visual-Gated LoRA. We split the content LoRA into two branches with different ranks, guided by image saliency. The high-rank branch preserves primary subject information, while the low-rank branch encodes residual details, mitigating content overfitting and enabling seamless re-embedding. Extensive experiments demonstrate that SplitFlux consistently outperforms state-of-the-art methods, achieving superior content preservation and stylization quality across diverse scenarios.
title SplitFlux: Learning to Decouple Content and Style from a Single Image
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.15258