InfoAffect: Affective Annotations of Infographics in Information Spread

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Fu, Zihang, Wang, Yunchao, Huang, Chenyu, Sun, Guodao, Liang, Ronghua
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866912827073101824
author Fu, Zihang
Wang, Yunchao
Huang, Chenyu
Sun, Guodao
Liang, Ronghua
author_facet Fu, Zihang
Wang, Yunchao
Huang, Chenyu
Sun, Guodao
Liang, Ronghua
contents Infographics are widely used in social media to convey complex information, yet how they influence users' affects remains underexplored due to the scarcity of relevant datasets. To address this gap, we introduce a 3.5k-sample affect-annotated InfoAffect dataset, which combines textual content with real-world infographics. We first collected the raw data from six fields and aligned it via preprocessing, the accompanied-text-priority method, and three strategies to guarantee quality and compliance. After that, we constructed an Affect Table to constrain annotation. We used five state-of-the-art multimodal large language models (MLLMs) to analyze both modalities, and their outputs were fused with the Reciprocal Rank Fusion (RRF) algorithm to yield robust affects and confidences. We conducted a user study with two experiments to validate usability and assess the InfoAffect dataset using the Composite Affect Consistency Index (CACI), achieving an overall score of 0.608, which indicates high accuracy. The InfoAffect dataset is available in a public repository at https://github.com/bulichuchu/InfoAffect-dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2511_06404
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle InfoAffect: Affective Annotations of Infographics in Information Spread
Fu, Zihang
Wang, Yunchao
Huang, Chenyu
Sun, Guodao
Liang, Ronghua
Computer Vision and Pattern Recognition
Infographics are widely used in social media to convey complex information, yet how they influence users' affects remains underexplored due to the scarcity of relevant datasets. To address this gap, we introduce a 3.5k-sample affect-annotated InfoAffect dataset, which combines textual content with real-world infographics. We first collected the raw data from six fields and aligned it via preprocessing, the accompanied-text-priority method, and three strategies to guarantee quality and compliance. After that, we constructed an Affect Table to constrain annotation. We used five state-of-the-art multimodal large language models (MLLMs) to analyze both modalities, and their outputs were fused with the Reciprocal Rank Fusion (RRF) algorithm to yield robust affects and confidences. We conducted a user study with two experiments to validate usability and assess the InfoAffect dataset using the Composite Affect Consistency Index (CACI), achieving an overall score of 0.608, which indicates high accuracy. The InfoAffect dataset is available in a public repository at https://github.com/bulichuchu/InfoAffect-dataset.
title InfoAffect: Affective Annotations of Infographics in Information Spread
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.06404