Biased AI can Influence Political Decision-Making

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Fisher, Jillian, Feng, Shangbin, Aron, Robert, Richardson, Thomas, Choi, Yejin, Fisher, Daniel W., Pan, Jennifer, Tsvetkov, Yulia, Reinecke, Katharina
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911526845153280
author Fisher, Jillian
Feng, Shangbin
Aron, Robert
Richardson, Thomas
Choi, Yejin
Fisher, Daniel W.
Pan, Jennifer
Tsvetkov, Yulia
Reinecke, Katharina
author_facet Fisher, Jillian
Feng, Shangbin
Aron, Robert
Richardson, Thomas
Choi, Yejin
Fisher, Daniel W.
Pan, Jennifer
Tsvetkov, Yulia
Reinecke, Katharina
contents As modern large language models (LLMs) become integral to everyday tasks, concerns about their inherent biases and their potential impact on human decision-making have emerged. While bias in models are well-documented, less is known about how these biases influence human decisions. This paper presents two interactive experiments investigating the effects of partisan bias in LLMs on political opinions and decision-making. Participants interacted freely with either a biased liberal, biased conservative, or unbiased control model while completing these tasks. We found that participants exposed to partisan biased models were significantly more likely to adopt opinions and make decisions which matched the LLM's bias. Even more surprising, this influence was seen when the model bias and personal political partisanship of the participant were opposite. However, we also discovered that prior knowledge of AI was weakly correlated with a reduction of the impact of the bias, highlighting the possible importance of AI education for robust mitigation of bias effects. Our findings not only highlight the critical effects of interacting with biased LLMs and its ability to impact public discourse and political conduct, but also highlights potential techniques for mitigating these risks in the future.
format Preprint
id arxiv_https___arxiv_org_abs_2410_06415
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Biased AI can Influence Political Decision-Making
Fisher, Jillian
Feng, Shangbin
Aron, Robert
Richardson, Thomas
Choi, Yejin
Fisher, Daniel W.
Pan, Jennifer
Tsvetkov, Yulia
Reinecke, Katharina
Human-Computer Interaction
Artificial Intelligence
As modern large language models (LLMs) become integral to everyday tasks, concerns about their inherent biases and their potential impact on human decision-making have emerged. While bias in models are well-documented, less is known about how these biases influence human decisions. This paper presents two interactive experiments investigating the effects of partisan bias in LLMs on political opinions and decision-making. Participants interacted freely with either a biased liberal, biased conservative, or unbiased control model while completing these tasks. We found that participants exposed to partisan biased models were significantly more likely to adopt opinions and make decisions which matched the LLM's bias. Even more surprising, this influence was seen when the model bias and personal political partisanship of the participant were opposite. However, we also discovered that prior knowledge of AI was weakly correlated with a reduction of the impact of the bias, highlighting the possible importance of AI education for robust mitigation of bias effects. Our findings not only highlight the critical effects of interacting with biased LLMs and its ability to impact public discourse and political conduct, but also highlights potential techniques for mitigating these risks in the future.
title Biased AI can Influence Political Decision-Making
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2410.06415