SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Peng, Qiwei, Moro, Robert, Gregor, Michal, Srba, Ivan, Ostermann, Simon, Simko, Marian, Podroužek, Juraj, Mesarčík, Matúš, Kopčan, Jaroslav, Søgaard, Anders
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912379188543488
author Peng, Qiwei
Moro, Robert
Gregor, Michal
Srba, Ivan
Ostermann, Simon
Simko, Marian
Podroužek, Juraj
Mesarčík, Matúš
Kopčan, Jaroslav
Søgaard, Anders
author_facet Peng, Qiwei
Moro, Robert
Gregor, Michal
Srba, Ivan
Ostermann, Simon
Simko, Marian
Podroužek, Juraj
Mesarčík, Matúš
Kopčan, Jaroslav
Søgaard, Anders
contents The rapid spread of online disinformation presents a global challenge, and machine learning has been widely explored as a potential solution. However, multilingual settings and low-resource languages are often neglected in this field. To address this gap, we conducted a shared task on multilingual claim retrieval at SemEval 2025, aimed at identifying fact-checked claims that match newly encountered claims expressed in social media posts across different languages. The task includes two subtracks: (1) a monolingual track, where social posts and claims are in the same language, and (2) a crosslingual track, where social posts and claims might be in different languages. A total of 179 participants registered for the task contributing to 52 test submissions. 23 out of 31 teams have submitted their system papers. In this paper, we report the best-performing systems as well as the most common and the most effective approaches across both subtracks. This shared task, along with its dataset and participating systems, provides valuable insights into multilingual claim retrieval and automated fact-checking, supporting future research in this field.
format Preprint
id arxiv_https___arxiv_org_abs_2505_10740
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval
Peng, Qiwei
Moro, Robert
Gregor, Michal
Srba, Ivan
Ostermann, Simon
Simko, Marian
Podroužek, Juraj
Mesarčík, Matúš
Kopčan, Jaroslav
Søgaard, Anders
Computation and Language
Information Retrieval
The rapid spread of online disinformation presents a global challenge, and machine learning has been widely explored as a potential solution. However, multilingual settings and low-resource languages are often neglected in this field. To address this gap, we conducted a shared task on multilingual claim retrieval at SemEval 2025, aimed at identifying fact-checked claims that match newly encountered claims expressed in social media posts across different languages. The task includes two subtracks: (1) a monolingual track, where social posts and claims are in the same language, and (2) a crosslingual track, where social posts and claims might be in different languages. A total of 179 participants registered for the task contributing to 52 test submissions. 23 out of 31 teams have submitted their system papers. In this paper, we report the best-performing systems as well as the most common and the most effective approaches across both subtracks. This shared task, along with its dataset and participating systems, provides valuable insights into multilingual claim retrieval and automated fact-checking, supporting future research in this field.
title SemEval-2025 Task 7: Multilingual and Crosslingual Fact-Checked Claim Retrieval
topic Computation and Language
Information Retrieval
url https://arxiv.org/abs/2505.10740