VAEER: Visual Attention-Inspired Emotion Elicitation Reasoning

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Man, Fanhang, Chen, Xiaoyue, Wang, Huandong, Zhao, Baining, Li, Han, Chen, Xinlei
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912772089970688
author Man, Fanhang
Chen, Xiaoyue
Wang, Huandong
Zhao, Baining
Li, Han
Chen, Xinlei
author_facet Man, Fanhang
Chen, Xiaoyue
Wang, Huandong
Zhao, Baining
Li, Han
Chen, Xinlei
contents Images shared online strongly influence emotions and public well-being. Understanding the emotions an image elicits is therefore vital for fostering healthier and more sustainable digital communities, especially during public crises. We study Visual Emotion Elicitation (VEE), predicting the set of emotions that an image evokes in viewers. We introduce VAEER, an interpretable multi-label VEE framework that combines attention-inspired cue extraction with knowledge-grounded reasoning. VAEER isolates salient visual foci and contextual signals, aligns them with structured affective knowledge, and performs per-emotion inference to yield transparent, emotion-specific rationales. Across three heterogeneous benchmarks, including social imagery and disaster-related photos, VAEER achieves state-of-the-art results with up to 19% per-emotion improvements and a 12.3% average gain over strong CNN and VLM baselines. Our findings highlight interpretable multi-label emotion elicitation as a scalable foundation for responsible visual media analysis and emotionally sustainable online ecosystems.
format Preprint
id arxiv_https___arxiv_org_abs_2505_24342
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle VAEER: Visual Attention-Inspired Emotion Elicitation Reasoning
Man, Fanhang
Chen, Xiaoyue
Wang, Huandong
Zhao, Baining
Li, Han
Chen, Xinlei
Computer Vision and Pattern Recognition
Computation and Language
Images shared online strongly influence emotions and public well-being. Understanding the emotions an image elicits is therefore vital for fostering healthier and more sustainable digital communities, especially during public crises. We study Visual Emotion Elicitation (VEE), predicting the set of emotions that an image evokes in viewers. We introduce VAEER, an interpretable multi-label VEE framework that combines attention-inspired cue extraction with knowledge-grounded reasoning. VAEER isolates salient visual foci and contextual signals, aligns them with structured affective knowledge, and performs per-emotion inference to yield transparent, emotion-specific rationales. Across three heterogeneous benchmarks, including social imagery and disaster-related photos, VAEER achieves state-of-the-art results with up to 19% per-emotion improvements and a 12.3% average gain over strong CNN and VLM baselines. Our findings highlight interpretable multi-label emotion elicitation as a scalable foundation for responsible visual media analysis and emotionally sustainable online ecosystems.
title VAEER: Visual Attention-Inspired Emotion Elicitation Reasoning
topic Computer Vision and Pattern Recognition
Computation and Language
url https://arxiv.org/abs/2505.24342