Persona-driven Simulation of Voting Behavior in the European Parliament with Large Language Models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Kreutner, Maximilian, Lutz, Marlene, Strohmaier, Markus
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912912394682368
author Kreutner, Maximilian
Lutz, Marlene
Strohmaier, Markus
author_facet Kreutner, Maximilian
Lutz, Marlene
Strohmaier, Markus
contents Large Language Models (LLMs) display remarkable capabilities to understand or even produce political discourse but have been found to consistently exhibit a progressive left-leaning bias. At the same time, so-called persona or identity prompts have been shown to produce LLM behavior that aligns with socioeconomic groups with which the base model is not aligned. In this work, we analyze whether zero-shot persona prompting with limited information can accurately predict individual voting decisions and, by aggregation, accurately predict the positions of European groups on a diverse set of policies. We evaluate whether predictions are stable in response to counterfactual arguments, different persona prompts, and generation methods. Finally, we find that we can simulate the voting behavior of Members of the European Parliament reasonably well, achieving a weighted F1 score of approximately 0.793. Our persona dataset of politicians in the 2024 European Parliament and our code are available at the following url: https://github.com/dess-mannheim/european_parliament_simulation.
format Preprint
id arxiv_https___arxiv_org_abs_2506_11798
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Persona-driven Simulation of Voting Behavior in the European Parliament with Large Language Models
Kreutner, Maximilian
Lutz, Marlene
Strohmaier, Markus
Computation and Language
Artificial Intelligence
Machine Learning
Large Language Models (LLMs) display remarkable capabilities to understand or even produce political discourse but have been found to consistently exhibit a progressive left-leaning bias. At the same time, so-called persona or identity prompts have been shown to produce LLM behavior that aligns with socioeconomic groups with which the base model is not aligned. In this work, we analyze whether zero-shot persona prompting with limited information can accurately predict individual voting decisions and, by aggregation, accurately predict the positions of European groups on a diverse set of policies. We evaluate whether predictions are stable in response to counterfactual arguments, different persona prompts, and generation methods. Finally, we find that we can simulate the voting behavior of Members of the European Parliament reasonably well, achieving a weighted F1 score of approximately 0.793. Our persona dataset of politicians in the 2024 European Parliament and our code are available at the following url: https://github.com/dess-mannheim/european_parliament_simulation.
title Persona-driven Simulation of Voting Behavior in the European Parliament with Large Language Models
topic Computation and Language
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2506.11798