Large Language Models for Multilingual Previously Fact-Checked Claim Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Vykopal, Ivan, Pikuliak, Matúš, Ostermann, Simon, Anikina, Tatiana, Gregor, Michal, Šimko, Marián
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918146769682432
author Vykopal, Ivan
Pikuliak, Matúš
Ostermann, Simon
Anikina, Tatiana
Gregor, Michal
Šimko, Marián
author_facet Vykopal, Ivan
Pikuliak, Matúš
Ostermann, Simon
Anikina, Tatiana
Gregor, Michal
Šimko, Marián
contents In our era of widespread false information, human fact-checkers often face the challenge of duplicating efforts when verifying claims that may have already been addressed in other countries or languages. As false information transcends linguistic boundaries, the ability to automatically detect previously fact-checked claims across languages has become an increasingly important task. This paper presents the first comprehensive evaluation of large language models (LLMs) for multilingual previously fact-checked claim detection. We assess seven LLMs across 20 languages in both monolingual and cross-lingual settings. Our results show that while LLMs perform well for high-resource languages, they struggle with low-resource languages. Moreover, translating original texts into English proved to be beneficial for low-resource languages. These findings highlight the potential of LLMs for multilingual previously fact-checked claim detection and provide a foundation for further research on this promising application of LLMs.
format Preprint
id arxiv_https___arxiv_org_abs_2503_02737
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Large Language Models for Multilingual Previously Fact-Checked Claim Detection
Vykopal, Ivan
Pikuliak, Matúš
Ostermann, Simon
Anikina, Tatiana
Gregor, Michal
Šimko, Marián
Computation and Language
In our era of widespread false information, human fact-checkers often face the challenge of duplicating efforts when verifying claims that may have already been addressed in other countries or languages. As false information transcends linguistic boundaries, the ability to automatically detect previously fact-checked claims across languages has become an increasingly important task. This paper presents the first comprehensive evaluation of large language models (LLMs) for multilingual previously fact-checked claim detection. We assess seven LLMs across 20 languages in both monolingual and cross-lingual settings. Our results show that while LLMs perform well for high-resource languages, they struggle with low-resource languages. Moreover, translating original texts into English proved to be beneficial for low-resource languages. These findings highlight the potential of LLMs for multilingual previously fact-checked claim detection and provide a foundation for further research on this promising application of LLMs.
title Large Language Models for Multilingual Previously Fact-Checked Claim Detection
topic Computation and Language
url https://arxiv.org/abs/2503.02737