Multilingual, Multimodal Pipeline for Creating Authentic and Structured Fact-Checked Claim Dataset

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Hüsünbeyi, Z. Melce, Mouilleron, Virginie, Uhling, Leonie, Foppe, Daniel, Scheffler, Tatjana, Seddah, Djamé
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908892558000128
author Hüsünbeyi, Z. Melce
Mouilleron, Virginie
Uhling, Leonie
Foppe, Daniel
Scheffler, Tatjana
Seddah, Djamé
author_facet Hüsünbeyi, Z. Melce
Mouilleron, Virginie
Uhling, Leonie
Foppe, Daniel
Scheffler, Tatjana
Seddah, Djamé
contents The rapid proliferation of misinformation across online platforms underscores the urgent need for robust, up-to-date, explainable, and multilingual fact-checking resources. However, existing datasets are limited in scope, often lacking multimodal evidence, structured annotations, and detailed links between claims, evidence, and verdicts. This paper introduces a comprehensive data collection and processing pipeline that constructs multimodal fact-checking datasets in French and German languages by aggregating ClaimReview feeds, scraping full debunking articles, normalizing heterogeneous claim verdicts, and enriching them with structured metadata and aligned visual content. We used state-of-the-art large language models (LLMs) and multimodal LLMs for (i) evidence extraction under predefined evidence categories and (ii) justification generation that links evidence to verdicts. Evaluation with G-Eval and human assessment demonstrates that our pipeline enables fine-grained comparison of fact-checking practices across different organizations or media markets, facilitates the development of more interpretable and evidence-grounded fact-checking models, and lays the groundwork for future research on multilingual, multimodal misinformation verification.
format Preprint
id arxiv_https___arxiv_org_abs_2601_07985
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Multilingual, Multimodal Pipeline for Creating Authentic and Structured Fact-Checked Claim Dataset
Hüsünbeyi, Z. Melce
Mouilleron, Virginie
Uhling, Leonie
Foppe, Daniel
Scheffler, Tatjana
Seddah, Djamé
Computation and Language
The rapid proliferation of misinformation across online platforms underscores the urgent need for robust, up-to-date, explainable, and multilingual fact-checking resources. However, existing datasets are limited in scope, often lacking multimodal evidence, structured annotations, and detailed links between claims, evidence, and verdicts. This paper introduces a comprehensive data collection and processing pipeline that constructs multimodal fact-checking datasets in French and German languages by aggregating ClaimReview feeds, scraping full debunking articles, normalizing heterogeneous claim verdicts, and enriching them with structured metadata and aligned visual content. We used state-of-the-art large language models (LLMs) and multimodal LLMs for (i) evidence extraction under predefined evidence categories and (ii) justification generation that links evidence to verdicts. Evaluation with G-Eval and human assessment demonstrates that our pipeline enables fine-grained comparison of fact-checking practices across different organizations or media markets, facilitates the development of more interpretable and evidence-grounded fact-checking models, and lays the groundwork for future research on multilingual, multimodal misinformation verification.
title Multilingual, Multimodal Pipeline for Creating Authentic and Structured Fact-Checked Claim Dataset
topic Computation and Language
url https://arxiv.org/abs/2601.07985