CharaConsist: Fine-Grained Consistent Character Generation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wang, Mengyu, Ding, Henghui, Peng, Jianing, Zhao, Yao, Chen, Yunpeng, Wei, Yunchao
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911058146361344
author Wang, Mengyu
Ding, Henghui
Peng, Jianing
Zhao, Yao
Chen, Yunpeng
Wei, Yunchao
author_facet Wang, Mengyu
Ding, Henghui
Peng, Jianing
Zhao, Yao
Chen, Yunpeng
Wei, Yunchao
contents In text-to-image generation, producing a series of consistent contents that preserve the same identity is highly valuable for real-world applications. Although a few works have explored training-free methods to enhance the consistency of generated subjects, we observe that they suffer from the following problems. First, they fail to maintain consistent background details, which limits their applicability. Furthermore, when the foreground character undergoes large motion variations, inconsistencies in identity and clothing details become evident. To address these problems, we propose CharaConsist, which employs point-tracking attention and adaptive token merge along with decoupled control of the foreground and background. CharaConsist enables fine-grained consistency for both foreground and background, supporting the generation of one character in continuous shots within a fixed scene or in discrete shots across different scenes. Moreover, CharaConsist is the first consistent generation method tailored for text-to-image DiT model. Its ability to maintain fine-grained consistency, combined with the larger capacity of latest base model, enables it to produce high-quality visual outputs, broadening its applicability to a wider range of real-world scenarios. The source code has been released at https://github.com/Murray-Wang/CharaConsist
format Preprint
id arxiv_https___arxiv_org_abs_2507_11533
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CharaConsist: Fine-Grained Consistent Character Generation
Wang, Mengyu
Ding, Henghui
Peng, Jianing
Zhao, Yao
Chen, Yunpeng
Wei, Yunchao
Computer Vision and Pattern Recognition
In text-to-image generation, producing a series of consistent contents that preserve the same identity is highly valuable for real-world applications. Although a few works have explored training-free methods to enhance the consistency of generated subjects, we observe that they suffer from the following problems. First, they fail to maintain consistent background details, which limits their applicability. Furthermore, when the foreground character undergoes large motion variations, inconsistencies in identity and clothing details become evident. To address these problems, we propose CharaConsist, which employs point-tracking attention and adaptive token merge along with decoupled control of the foreground and background. CharaConsist enables fine-grained consistency for both foreground and background, supporting the generation of one character in continuous shots within a fixed scene or in discrete shots across different scenes. Moreover, CharaConsist is the first consistent generation method tailored for text-to-image DiT model. Its ability to maintain fine-grained consistency, combined with the larger capacity of latest base model, enables it to produce high-quality visual outputs, broadening its applicability to a wider range of real-world scenarios. The source code has been released at https://github.com/Murray-Wang/CharaConsist
title CharaConsist: Fine-Grained Consistent Character Generation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.11533