AttnMod: Attention-Based New Art Styles

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autor principal: Su, Shih-Chieh
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908474197147648
author Su, Shih-Chieh
author_facet Su, Shih-Chieh
contents We introduce AttnMod, a training-free technique that modulates cross-attention in pre-trained diffusion models to generate novel, unpromptable art styles. The method is inspired by how a human artist might reinterpret a generated image, for example by emphasizing certain features, dispersing color, twisting silhouettes, or materializing unseen elements. AttnMod simulates this intent by altering how the text prompt conditions the image through attention during denoising. These targeted modulations enable diverse stylistic transformations without changing the prompt or retraining the model, and they expand the expressive capacity of text-to-image generation.
format Preprint
id arxiv_https___arxiv_org_abs_2409_10028
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle AttnMod: Attention-Based New Art Styles
Su, Shih-Chieh
Computer Vision and Pattern Recognition
Artificial Intelligence
We introduce AttnMod, a training-free technique that modulates cross-attention in pre-trained diffusion models to generate novel, unpromptable art styles. The method is inspired by how a human artist might reinterpret a generated image, for example by emphasizing certain features, dispersing color, twisting silhouettes, or materializing unseen elements. AttnMod simulates this intent by altering how the text prompt conditions the image through attention during denoising. These targeted modulations enable diverse stylistic transformations without changing the prompt or retraining the model, and they expand the expressive capacity of text-to-image generation.
title AttnMod: Attention-Based New Art Styles
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2409.10028