Multi-Modal Framing Analysis of News

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Arora, Arnav, Yadav, Srishti, Antoniak, Maria, Belongie, Serge, Augenstein, Isabelle
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918037917007872
author Arora, Arnav
Yadav, Srishti
Antoniak, Maria
Belongie, Serge
Augenstein, Isabelle
author_facet Arora, Arnav
Yadav, Srishti
Antoniak, Maria
Belongie, Serge
Augenstein, Isabelle
contents Automated frame analysis of political communication is a popular task in computational social science that is used to study how authors select aspects of a topic to frame its reception. So far, such studies have been narrow, in that they use a fixed set of pre-defined frames and focus only on the text, ignoring the visual contexts in which those texts appear. Especially for framing in the news, this leaves out valuable information about editorial choices, which include not just the written article but also accompanying photographs. To overcome such limitations, we present a method for conducting multi-modal, multi-label framing analysis at scale using large (vision-) language models. Grounding our work in framing theory, we extract latent meaning embedded in images used to convey a certain point and contrast that to the text by comparing the respective frames used. We also identify highly partisan framing of topics with issue-specific frame analysis found in prior qualitative work. We demonstrate a method for doing scalable integrative framing analysis of both text and image in news, providing a more complete picture for understanding media bias.
format Preprint
id arxiv_https___arxiv_org_abs_2503_20960
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Multi-Modal Framing Analysis of News
Arora, Arnav
Yadav, Srishti
Antoniak, Maria
Belongie, Serge
Augenstein, Isabelle
Computation and Language
Computers and Society
Machine Learning
Automated frame analysis of political communication is a popular task in computational social science that is used to study how authors select aspects of a topic to frame its reception. So far, such studies have been narrow, in that they use a fixed set of pre-defined frames and focus only on the text, ignoring the visual contexts in which those texts appear. Especially for framing in the news, this leaves out valuable information about editorial choices, which include not just the written article but also accompanying photographs. To overcome such limitations, we present a method for conducting multi-modal, multi-label framing analysis at scale using large (vision-) language models. Grounding our work in framing theory, we extract latent meaning embedded in images used to convey a certain point and contrast that to the text by comparing the respective frames used. We also identify highly partisan framing of topics with issue-specific frame analysis found in prior qualitative work. We demonstrate a method for doing scalable integrative framing analysis of both text and image in news, providing a more complete picture for understanding media bias.
title Multi-Modal Framing Analysis of News
topic Computation and Language
Computers and Society
Machine Learning
url https://arxiv.org/abs/2503.20960