Training-Free Diffusion Framework for Stylized Image Generation with Identity Preservation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Rezaei, Mohammad Ali, Hajikazem, Helia, Khanehgir, Saeed, Javanmardi, Mahdi
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909811846676480
author Rezaei, Mohammad Ali
Hajikazem, Helia
Khanehgir, Saeed
Javanmardi, Mahdi
author_facet Rezaei, Mohammad Ali
Hajikazem, Helia
Khanehgir, Saeed
Javanmardi, Mahdi
contents Although diffusion models have demonstrated remarkable generative capabilities, existing style transfer techniques often struggle to maintain identity while achieving high-quality stylization. This limitation becomes particularly critical in practical applications such as advertising and marketing, where preserving the identity of featured individuals is essential for a campaign's effectiveness. It is particularly severe when subjects are distant from the camera or appear within a group, frequently leading to a significant loss of identity. To address this issue, we introduce a novel, training-free framework for identity-preserved stylized image synthesis. Key contributions include the "Mosaic Restored Content Image" technique, which significantly enhances identity retention in complex scenes, and a training-free content consistency loss that improves the preservation of fine-grained details by directing more attention to the original image during stylization. Our experiments reveal that the proposed approach substantially exceeds the baseline model in concurrently maintaining high stylistic fidelity and robust identity integrity, all without necessitating model retraining or fine-tuning.
format Preprint
id arxiv_https___arxiv_org_abs_2506_06802
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Training-Free Diffusion Framework for Stylized Image Generation with Identity Preservation
Rezaei, Mohammad Ali
Hajikazem, Helia
Khanehgir, Saeed
Javanmardi, Mahdi
Computer Vision and Pattern Recognition
Although diffusion models have demonstrated remarkable generative capabilities, existing style transfer techniques often struggle to maintain identity while achieving high-quality stylization. This limitation becomes particularly critical in practical applications such as advertising and marketing, where preserving the identity of featured individuals is essential for a campaign's effectiveness. It is particularly severe when subjects are distant from the camera or appear within a group, frequently leading to a significant loss of identity. To address this issue, we introduce a novel, training-free framework for identity-preserved stylized image synthesis. Key contributions include the "Mosaic Restored Content Image" technique, which significantly enhances identity retention in complex scenes, and a training-free content consistency loss that improves the preservation of fine-grained details by directing more attention to the original image during stylization. Our experiments reveal that the proposed approach substantially exceeds the baseline model in concurrently maintaining high stylistic fidelity and robust identity integrity, all without necessitating model retraining or fine-tuning.
title Training-Free Diffusion Framework for Stylized Image Generation with Identity Preservation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.06802