Saved in:
Bibliographic Details
Main Authors: Islam, Muhammad, Khan, Javed Ali, Abaker, Mohammed, Daud, Ali, Irshad, Azeem
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2506.01587
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915318245359616
author Islam, Muhammad
Khan, Javed Ali
Abaker, Mohammed
Daud, Ali
Irshad, Azeem
author_facet Islam, Muhammad
Khan, Javed Ali
Abaker, Mohammed
Daud, Ali
Irshad, Azeem
contents The rapid expansion of social media platforms has significantly increased the dissemination of forged content and misinformation, making the detection of fake news a critical area of research. Although fact-checking efforts predominantly focus on English-language news, there is a noticeable gap in resources and strategies to detect news in regional languages, such as Urdu. Advanced Fake News Detection (FND) techniques rely heavily on large, accurately labeled datasets. However, FND in under-resourced languages like Urdu faces substantial challenges due to the scarcity of extensive corpora and the lack of validated lexical resources. Current Urdu fake news datasets are often domain-specific and inaccessible to the public. They also lack human verification, relying mainly on unverified English-to-Urdu translations, which compromises their reliability in practical applications. This study highlights the necessity of developing reliable, expert-verified, and domain-independent Urdu-enhanced FND datasets to improve fake news detection in Urdu and other resource-constrained languages. This paper presents the first benchmark large FND dataset for Urdu news, which is publicly available for validation and deep analysis. We also evaluate this dataset using multiple state-of-the-art pre-trained large language models (LLMs), such as XLNet, mBERT, XLM-RoBERTa, RoBERTa, DistilBERT, and DeBERTa. Additionally, we propose a unified LLM model that outperforms the others with different embedding and feature extraction techniques. The performance of these models is compared based on accuracy, F1 score, precision, recall, and human judgment for vetting the sample results of news.
format Preprint
id arxiv_https___arxiv_org_abs_2506_01587
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Unified Large Language Models for Misinformation Detection in Low-Resource Linguistic Settings
Islam, Muhammad
Khan, Javed Ali
Abaker, Mohammed
Daud, Ali
Irshad, Azeem
Computation and Language
The rapid expansion of social media platforms has significantly increased the dissemination of forged content and misinformation, making the detection of fake news a critical area of research. Although fact-checking efforts predominantly focus on English-language news, there is a noticeable gap in resources and strategies to detect news in regional languages, such as Urdu. Advanced Fake News Detection (FND) techniques rely heavily on large, accurately labeled datasets. However, FND in under-resourced languages like Urdu faces substantial challenges due to the scarcity of extensive corpora and the lack of validated lexical resources. Current Urdu fake news datasets are often domain-specific and inaccessible to the public. They also lack human verification, relying mainly on unverified English-to-Urdu translations, which compromises their reliability in practical applications. This study highlights the necessity of developing reliable, expert-verified, and domain-independent Urdu-enhanced FND datasets to improve fake news detection in Urdu and other resource-constrained languages. This paper presents the first benchmark large FND dataset for Urdu news, which is publicly available for validation and deep analysis. We also evaluate this dataset using multiple state-of-the-art pre-trained large language models (LLMs), such as XLNet, mBERT, XLM-RoBERTa, RoBERTa, DistilBERT, and DeBERTa. Additionally, we propose a unified LLM model that outperforms the others with different embedding and feature extraction techniques. The performance of these models is compared based on accuracy, F1 score, precision, recall, and human judgment for vetting the sample results of news.
title Unified Large Language Models for Misinformation Detection in Low-Resource Linguistic Settings
topic Computation and Language
url https://arxiv.org/abs/2506.01587