Read Between the Lines: A Benchmark for Uncovering Political Bias in Bangla News Articles
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866912714759077888 |
|---|---|
| author | Lia, Nusrat Jahan Dipta, Shubhashis Roy Zehady, Abdullah Khan Islam, Naymul Chakraborty, Madhusodan Wasif, Abdullah Al |
| author_facet | Lia, Nusrat Jahan Dipta, Shubhashis Roy Zehady, Abdullah Khan Islam, Naymul Chakraborty, Madhusodan Wasif, Abdullah Al |
| contents | Detecting media bias is crucial, specifically in the South Asian region. Despite this, annotated datasets and computational studies for Bangla political bias research remain scarce. Crucially because, political stance detection in Bangla news requires understanding of linguistic cues, cultural context, subtle biases, rhetorical strategies, code-switching, implicit sentiment, and socio-political background. To address this, we introduce the first benchmark dataset of 200 politically significant and highly debated Bangla news articles, labeled for government-leaning, government-critique, and neutral stances, alongside diagnostic analyses for evaluating large language models (LLMs). Our comprehensive evaluation of 28 proprietary and open-source LLMs shows strong performance in detecting government-critique content (F1 up to 0.83) but substantial difficulty with neutral articles (F1 as low as 0.00). Models also tend to over-predict government-leaning stances, often misinterpreting ambiguous narratives. This dataset and its associated diagnostics provide a foundation for advancing stance detection in Bangla media research and offer insights for improving LLM performance in low-resource languages. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_03898 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Read Between the Lines: A Benchmark for Uncovering Political Bias in Bangla News Articles Lia, Nusrat Jahan Dipta, Shubhashis Roy Zehady, Abdullah Khan Islam, Naymul Chakraborty, Madhusodan Wasif, Abdullah Al Computation and Language Detecting media bias is crucial, specifically in the South Asian region. Despite this, annotated datasets and computational studies for Bangla political bias research remain scarce. Crucially because, political stance detection in Bangla news requires understanding of linguistic cues, cultural context, subtle biases, rhetorical strategies, code-switching, implicit sentiment, and socio-political background. To address this, we introduce the first benchmark dataset of 200 politically significant and highly debated Bangla news articles, labeled for government-leaning, government-critique, and neutral stances, alongside diagnostic analyses for evaluating large language models (LLMs). Our comprehensive evaluation of 28 proprietary and open-source LLMs shows strong performance in detecting government-critique content (F1 up to 0.83) but substantial difficulty with neutral articles (F1 as low as 0.00). Models also tend to over-predict government-leaning stances, often misinterpreting ambiguous narratives. This dataset and its associated diagnostics provide a foundation for advancing stance detection in Bangla media research and offer insights for improving LLM performance in low-resource languages. |
| title | Read Between the Lines: A Benchmark for Uncovering Political Bias in Bangla News Articles |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2510.03898 |