Beyond Western Politics: Cross-Cultural Benchmarks for Evaluating Partisan Associations in LLMs
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911179141545984 |
|---|---|
| author | Kumar, Divyanshu Gupta, Ishita Birur, Nitin Aravind Baswa, Tanay Agarwal, Sahil Harshangi, Prashanth |
| author_facet | Kumar, Divyanshu Gupta, Ishita Birur, Nitin Aravind Baswa, Tanay Agarwal, Sahil Harshangi, Prashanth |
| contents | Partisan bias in LLMs has been evaluated to assess political leanings, typically through a broad lens and largely in Western contexts. We move beyond identifying general leanings to examine harmful, adversarial representational associations around political leaders and parties. To do so, we create datasets \textit{NeutQA-440} (non-adversarial prompts) and \textit{AdverQA-440} (adversarial prompts), which probe models for comparative plausibility judgments across the USA and India. Results show high susceptibility to biased partisan associations and pronounced asymmetries (e.g., substantially more favorable associations for U.S. Democrats than Republicans) alongside mixed-polarity concentration around India's BJP, highlighting systemic risks and motivating standardized, cross-cultural evaluation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_22711 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Beyond Western Politics: Cross-Cultural Benchmarks for Evaluating Partisan Associations in LLMs Kumar, Divyanshu Gupta, Ishita Birur, Nitin Aravind Baswa, Tanay Agarwal, Sahil Harshangi, Prashanth Computers and Society Human-Computer Interaction Partisan bias in LLMs has been evaluated to assess political leanings, typically through a broad lens and largely in Western contexts. We move beyond identifying general leanings to examine harmful, adversarial representational associations around political leaders and parties. To do so, we create datasets \textit{NeutQA-440} (non-adversarial prompts) and \textit{AdverQA-440} (adversarial prompts), which probe models for comparative plausibility judgments across the USA and India. Results show high susceptibility to biased partisan associations and pronounced asymmetries (e.g., substantially more favorable associations for U.S. Democrats than Republicans) alongside mixed-polarity concentration around India's BJP, highlighting systemic risks and motivating standardized, cross-cultural evaluation. |
| title | Beyond Western Politics: Cross-Cultural Benchmarks for Evaluating Partisan Associations in LLMs |
| topic | Computers and Society Human-Computer Interaction |
| url | https://arxiv.org/abs/2509.22711 |