Mapping the Media Landscape: Predicting Factual Reporting and Political Bias Through Web Interactions

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Sánchez-Cortés, Dairazalia, Burdisso, Sergio, Villatoro-Tello, Esaú, Motlicek, Petr
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917813086584832
author Sánchez-Cortés, Dairazalia
Burdisso, Sergio
Villatoro-Tello, Esaú
Motlicek, Petr
author_facet Sánchez-Cortés, Dairazalia
Burdisso, Sergio
Villatoro-Tello, Esaú
Motlicek, Petr
contents Bias assessment of news sources is paramount for professionals, organizations, and researchers who rely on truthful evidence for information gathering and reporting. While certain bias indicators are discernible from content analysis, descriptors like political bias and fake news pose greater challenges. In this paper, we propose an extension to a recently presented news media reliability estimation method that focuses on modeling outlets and their longitudinal web interactions. Concretely, we assess the classification performance of four reinforcement learning strategies on a large news media hyperlink graph. Our experiments, targeting two challenging bias descriptors, factual reporting and political bias, showed a significant performance improvement at the source media level. Additionally, we validate our methods on the CLEF 2023 CheckThat! Lab challenge, outperforming the reported results in both, F1-score and the official MAE metric. Furthermore, we contribute by releasing the largest annotated dataset of news source media, categorized with factual reporting and political bias labels. Our findings suggest that profiling news media sources based on their hyperlink interactions over time is feasible, offering a bird's-eye view of evolving media landscapes.
format Preprint
id arxiv_https___arxiv_org_abs_2410_17655
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Mapping the Media Landscape: Predicting Factual Reporting and Political Bias Through Web Interactions
Sánchez-Cortés, Dairazalia
Burdisso, Sergio
Villatoro-Tello, Esaú
Motlicek, Petr
Artificial Intelligence
Computers and Society
Machine Learning
Bias assessment of news sources is paramount for professionals, organizations, and researchers who rely on truthful evidence for information gathering and reporting. While certain bias indicators are discernible from content analysis, descriptors like political bias and fake news pose greater challenges. In this paper, we propose an extension to a recently presented news media reliability estimation method that focuses on modeling outlets and their longitudinal web interactions. Concretely, we assess the classification performance of four reinforcement learning strategies on a large news media hyperlink graph. Our experiments, targeting two challenging bias descriptors, factual reporting and political bias, showed a significant performance improvement at the source media level. Additionally, we validate our methods on the CLEF 2023 CheckThat! Lab challenge, outperforming the reported results in both, F1-score and the official MAE metric. Furthermore, we contribute by releasing the largest annotated dataset of news source media, categorized with factual reporting and political bias labels. Our findings suggest that profiling news media sources based on their hyperlink interactions over time is feasible, offering a bird's-eye view of evolving media landscapes.
title Mapping the Media Landscape: Predicting Factual Reporting and Political Bias Through Web Interactions
topic Artificial Intelligence
Computers and Society
Machine Learning
url https://arxiv.org/abs/2410.17655