LLMs Can Infer Political Alignment from Online Conversations

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Lee, Byunghwee, Kim, Sangyeon, Menczer, Filippo, Ahn, Yong-Yeol, Kwak, Haewoon, An, Jisun
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908883134447616
author Lee, Byunghwee
Kim, Sangyeon
Menczer, Filippo
Ahn, Yong-Yeol
Kwak, Haewoon
An, Jisun
author_facet Lee, Byunghwee
Kim, Sangyeon
Menczer, Filippo
Ahn, Yong-Yeol
Kwak, Haewoon
An, Jisun
contents Due to the correlational structure in our traits such as identities, cultures, and political attitudes, seemingly innocuous preferences like following a band or using a specific slang can reveal private traits. This possibility, especially when combined with massive, public social data and advanced computational methods, poses a fundamental privacy risk. As our data exposure online and the rapid advancement of AI are increasing the risk of misuse, it is critical to understand the capacity of large language models (LLMs) to exploit such potential. Here, using online discussions on DebateOrg and Reddit, we show that LLMs can reliably infer hidden political alignment, significantly outperforming traditional machine learning models. Prediction accuracy further improves as we aggregate multiple text-level inferences into a user-level prediction, and as we use more politics-adjacent domains. We demonstrate that LLMs leverage words that are highly predictive of political alignment while not being explicitly political. Our findings underscore the capacity and risks of LLMs for exploiting socio-cultural correlates.
format Preprint
id arxiv_https___arxiv_org_abs_2603_11253
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle LLMs Can Infer Political Alignment from Online Conversations
Lee, Byunghwee
Kim, Sangyeon
Menczer, Filippo
Ahn, Yong-Yeol
Kwak, Haewoon
An, Jisun
Social and Information Networks
Computation and Language
Computers and Society
Due to the correlational structure in our traits such as identities, cultures, and political attitudes, seemingly innocuous preferences like following a band or using a specific slang can reveal private traits. This possibility, especially when combined with massive, public social data and advanced computational methods, poses a fundamental privacy risk. As our data exposure online and the rapid advancement of AI are increasing the risk of misuse, it is critical to understand the capacity of large language models (LLMs) to exploit such potential. Here, using online discussions on DebateOrg and Reddit, we show that LLMs can reliably infer hidden political alignment, significantly outperforming traditional machine learning models. Prediction accuracy further improves as we aggregate multiple text-level inferences into a user-level prediction, and as we use more politics-adjacent domains. We demonstrate that LLMs leverage words that are highly predictive of political alignment while not being explicitly political. Our findings underscore the capacity and risks of LLMs for exploiting socio-cultural correlates.
title LLMs Can Infer Political Alignment from Online Conversations
topic Social and Information Networks
Computation and Language
Computers and Society
url https://arxiv.org/abs/2603.11253