AnyArtisticGlyph: Multilingual Controllable Artistic Glyph Generation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Lu, Xiongbo, Chen, Yaxiong, Xiong, Shengwu
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866917979055194112
author Lu, Xiongbo
Chen, Yaxiong
Xiong, Shengwu
author_facet Lu, Xiongbo
Chen, Yaxiong
Xiong, Shengwu
contents Artistic Glyph Image Generation (AGIG) differs from current creativity-focused generation models by offering finely controllable deterministic generation. It transfers the style of a reference image to a source while preserving its content. Although advanced and promising, current methods may reveal flaws when scrutinizing synthesized image details, often producing blurred or incorrect textures, posing a significant challenge. Hence, we introduce AnyArtisticGlyph, a diffusion-based, multilingual controllable artistic glyph generation model. It includes a font fusion and embedding module, which generates latent features for detailed structure creation, and a vision-text fusion and embedding module that uses the CLIP model to encode references and blends them with transformation caption embeddings for seamless global image generation. Moreover, we incorporate a coarse-grained feature-level loss to enhance generation accuracy. Experiments show that it produces natural, detailed artistic glyph images with state-of-the-art performance. Our project will be open-sourced on https://github.com/jiean001/AnyArtisticGlyph to advance text generation technology.
format Preprint
id arxiv_https___arxiv_org_abs_2504_04743
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle AnyArtisticGlyph: Multilingual Controllable Artistic Glyph Generation
Lu, Xiongbo
Chen, Yaxiong
Xiong, Shengwu
Computer Vision and Pattern Recognition
Artistic Glyph Image Generation (AGIG) differs from current creativity-focused generation models by offering finely controllable deterministic generation. It transfers the style of a reference image to a source while preserving its content. Although advanced and promising, current methods may reveal flaws when scrutinizing synthesized image details, often producing blurred or incorrect textures, posing a significant challenge. Hence, we introduce AnyArtisticGlyph, a diffusion-based, multilingual controllable artistic glyph generation model. It includes a font fusion and embedding module, which generates latent features for detailed structure creation, and a vision-text fusion and embedding module that uses the CLIP model to encode references and blends them with transformation caption embeddings for seamless global image generation. Moreover, we incorporate a coarse-grained feature-level loss to enhance generation accuracy. Experiments show that it produces natural, detailed artistic glyph images with state-of-the-art performance. Our project will be open-sourced on https://github.com/jiean001/AnyArtisticGlyph to advance text generation technology.
title AnyArtisticGlyph: Multilingual Controllable Artistic Glyph Generation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.04743