Emulating Aggregate Human Choice Behavior and Biases with GPT Conversational Agents

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Pilli, Stephen, Nallur, Vivek
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912928384417792
author Pilli, Stephen
Nallur, Vivek
author_facet Pilli, Stephen
Nallur, Vivek
contents Cognitive biases often shape human decisions. While large language models (LLMs) have been shown to reproduce well-known biases, a more critical question is whether LLMs can predict biases at the individual level and emulate the dynamics of biased human behavior when contextual factors, such as cognitive load, interact with these biases. We adapted three well-established decision scenarios into a conversational setting and conducted a human experiment (N=1100). Participants engaged with a chatbot that facilitates decision-making through simple or complex dialogues. Results revealed robust biases. To evaluate how LLMs emulate human decision-making under similar interactive conditions, we used participant demographics and dialogue transcripts to simulate these conditions with LLMs based on GPT-4 and GPT-5. The LLMs reproduced human biases with precision. We found notable differences between models in how they aligned human behavior. This has important implications for designing and evaluating adaptive, bias-aware LLM-based AI systems in interactive contexts.
format Preprint
id arxiv_https___arxiv_org_abs_2602_05597
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Emulating Aggregate Human Choice Behavior and Biases with GPT Conversational Agents
Pilli, Stephen
Nallur, Vivek
Artificial Intelligence
Human-Computer Interaction
Multiagent Systems
Cognitive biases often shape human decisions. While large language models (LLMs) have been shown to reproduce well-known biases, a more critical question is whether LLMs can predict biases at the individual level and emulate the dynamics of biased human behavior when contextual factors, such as cognitive load, interact with these biases. We adapted three well-established decision scenarios into a conversational setting and conducted a human experiment (N=1100). Participants engaged with a chatbot that facilitates decision-making through simple or complex dialogues. Results revealed robust biases. To evaluate how LLMs emulate human decision-making under similar interactive conditions, we used participant demographics and dialogue transcripts to simulate these conditions with LLMs based on GPT-4 and GPT-5. The LLMs reproduced human biases with precision. We found notable differences between models in how they aligned human behavior. This has important implications for designing and evaluating adaptive, bias-aware LLM-based AI systems in interactive contexts.
title Emulating Aggregate Human Choice Behavior and Biases with GPT Conversational Agents
topic Artificial Intelligence
Human-Computer Interaction
Multiagent Systems
url https://arxiv.org/abs/2602.05597