Politically Speaking: LLMs on Changing International Affairs

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Cao, Xuenan, Chung, Wai Kei, Zhao, Ye, Zhou, Lidia Mengyuan
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908617305751552
author Cao, Xuenan
Chung, Wai Kei
Zhao, Ye
Zhou, Lidia Mengyuan
author_facet Cao, Xuenan
Chung, Wai Kei
Zhao, Ye
Zhou, Lidia Mengyuan
contents Ask your chatbot to impersonate an expert from Russia and an expert from US and query it on Chinese politics. How might the outputs differ? Or, to prepare ourselves for the worse, how might they converge? Scholars have raised concerns LLM based applications can homogenize cultures and flatten perspectives. But exactly how much does LLM generated outputs converge despite explicit different role assignment? This study provides empirical evidence to the above question. The critique centres on pretrained models regurgitating ossified political jargons used in the Western world when speaking about China, Iran, Russian, and US politics, despite changes in these countries happening daily or hourly. The experiments combine role-prompting and similarity metrics. The results show that AI generated discourses from four models about Iran and China are the most homogeneous and unchanging across all four models, including OpenAI GPT, Google Gemini, Anthropic Claude, and DeepSeek, despite the prompted perspective change and the actual changes in real life. This study does not engage with history, politics, or literature as traditional disciplinary approaches would; instead, it takes cues from international and area studies and offers insight on the future trajectory of shifting political discourse in a digital space increasingly cannibalised by AI.
format Preprint
id arxiv_https___arxiv_org_abs_2510_24582
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Politically Speaking: LLMs on Changing International Affairs
Cao, Xuenan
Chung, Wai Kei
Zhao, Ye
Zhou, Lidia Mengyuan
Computers and Society
Ask your chatbot to impersonate an expert from Russia and an expert from US and query it on Chinese politics. How might the outputs differ? Or, to prepare ourselves for the worse, how might they converge? Scholars have raised concerns LLM based applications can homogenize cultures and flatten perspectives. But exactly how much does LLM generated outputs converge despite explicit different role assignment? This study provides empirical evidence to the above question. The critique centres on pretrained models regurgitating ossified political jargons used in the Western world when speaking about China, Iran, Russian, and US politics, despite changes in these countries happening daily or hourly. The experiments combine role-prompting and similarity metrics. The results show that AI generated discourses from four models about Iran and China are the most homogeneous and unchanging across all four models, including OpenAI GPT, Google Gemini, Anthropic Claude, and DeepSeek, despite the prompted perspective change and the actual changes in real life. This study does not engage with history, politics, or literature as traditional disciplinary approaches would; instead, it takes cues from international and area studies and offers insight on the future trajectory of shifting political discourse in a digital space increasingly cannibalised by AI.
title Politically Speaking: LLMs on Changing International Affairs
topic Computers and Society
url https://arxiv.org/abs/2510.24582