LLM Voting: Human Choices and AI Collective Decision Making
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909433522552832 |
|---|---|
| author | Yang, Joshua C. Dailisan, Damian Korecki, Marcin Hausladen, Carina I. Helbing, Dirk |
| author_facet | Yang, Joshua C. Dailisan, Damian Korecki, Marcin Hausladen, Carina I. Helbing, Dirk |
| contents | This paper investigates the voting behaviors of Large Language Models (LLMs), specifically GPT-4 and LLaMA-2, their biases, and how they align with human voting patterns. Our methodology involved using a dataset from a human voting experiment to establish a baseline for human preferences and conducting a corresponding experiment with LLM agents. We observed that the choice of voting methods and the presentation order influenced LLM voting outcomes. We found that varying the persona can reduce some of these biases and enhance alignment with human choices. While the Chain-of-Thought approach did not improve prediction accuracy, it has potential for AI explainability in the voting process. We also identified a trade-off between preference diversity and alignment accuracy in LLMs, influenced by different temperature settings. Our findings indicate that LLMs may lead to less diverse collective outcomes and biased assumptions when used in voting scenarios, emphasizing the need for cautious integration of LLMs into democratic processes. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_01766 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | LLM Voting: Human Choices and AI Collective Decision Making Yang, Joshua C. Dailisan, Damian Korecki, Marcin Hausladen, Carina I. Helbing, Dirk Computation and Language Artificial Intelligence Computers and Society Machine Learning General Economics Economics 68T05, 91B14, 91C20 I.2.7; J.4; K.4.1 This paper investigates the voting behaviors of Large Language Models (LLMs), specifically GPT-4 and LLaMA-2, their biases, and how they align with human voting patterns. Our methodology involved using a dataset from a human voting experiment to establish a baseline for human preferences and conducting a corresponding experiment with LLM agents. We observed that the choice of voting methods and the presentation order influenced LLM voting outcomes. We found that varying the persona can reduce some of these biases and enhance alignment with human choices. While the Chain-of-Thought approach did not improve prediction accuracy, it has potential for AI explainability in the voting process. We also identified a trade-off between preference diversity and alignment accuracy in LLMs, influenced by different temperature settings. Our findings indicate that LLMs may lead to less diverse collective outcomes and biased assumptions when used in voting scenarios, emphasizing the need for cautious integration of LLMs into democratic processes. |
| title | LLM Voting: Human Choices and AI Collective Decision Making |
| topic | Computation and Language Artificial Intelligence Computers and Society Machine Learning General Economics Economics 68T05, 91B14, 91C20 I.2.7; J.4; K.4.1 |
| url | https://arxiv.org/abs/2402.01766 |