Towards Deeper Emotional Reflection: Crafting Affective Image Filters with Generative Priors

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhang, Peixuan, Weng, Shuchen, Tang, Jiajun, Li, Si, Shi, Boxin
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909975719182336
author Zhang, Peixuan
Weng, Shuchen
Tang, Jiajun
Li, Si
Shi, Boxin
author_facet Zhang, Peixuan
Weng, Shuchen
Tang, Jiajun
Li, Si
Shi, Boxin
contents Social media platforms enable users to express emotions by posting text with accompanying images. In this paper, we propose the Affective Image Filter (AIF) task, which aims to reflect visually-abstract emotions from text into visually-concrete images, thereby creating emotionally compelling results. We first introduce the AIF dataset and the formulation of the AIF models. Then, we present AIF-B as an initial attempt based on a multi-modal transformer architecture. After that, we propose AIF-D as an extension of AIF-B towards deeper emotional reflection, effectively leveraging generative priors from pre-trained large-scale diffusion models. Quantitative and qualitative experiments demonstrate that AIF models achieve superior performance for both content consistency and emotional fidelity compared to state-of-the-art methods. Extensive user study experiments demonstrate that AIF models are significantly more effective at evoking specific emotions. Based on the presented results, we comprehensively discuss the value and potential of AIF models.
format Preprint
id arxiv_https___arxiv_org_abs_2512_17376
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Towards Deeper Emotional Reflection: Crafting Affective Image Filters with Generative Priors
Zhang, Peixuan
Weng, Shuchen
Tang, Jiajun
Li, Si
Shi, Boxin
Computer Vision and Pattern Recognition
Social media platforms enable users to express emotions by posting text with accompanying images. In this paper, we propose the Affective Image Filter (AIF) task, which aims to reflect visually-abstract emotions from text into visually-concrete images, thereby creating emotionally compelling results. We first introduce the AIF dataset and the formulation of the AIF models. Then, we present AIF-B as an initial attempt based on a multi-modal transformer architecture. After that, we propose AIF-D as an extension of AIF-B towards deeper emotional reflection, effectively leveraging generative priors from pre-trained large-scale diffusion models. Quantitative and qualitative experiments demonstrate that AIF models achieve superior performance for both content consistency and emotional fidelity compared to state-of-the-art methods. Extensive user study experiments demonstrate that AIF models are significantly more effective at evoking specific emotions. Based on the presented results, we comprehensively discuss the value and potential of AIF models.
title Towards Deeper Emotional Reflection: Crafting Affective Image Filters with Generative Priors
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2512.17376