Persuasion at Play: Understanding Misinformation Dynamics in Demographic-Aware Human-LLM Interactions

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Borah, Angana, Mihalcea, Rada, Pérez-Rosas, Verónica
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917010089181184
author Borah, Angana
Mihalcea, Rada
Pérez-Rosas, Verónica
author_facet Borah, Angana
Mihalcea, Rada
Pérez-Rosas, Verónica
contents Existing challenges in misinformation exposure and susceptibility vary across demographic groups, as some populations are more vulnerable to misinformation than others. Large language models (LLMs) introduce new dimensions to these challenges through their ability to generate persuasive content at scale and reinforcing existing biases. This study investigates the bidirectional persuasion dynamics between LLMs and humans when exposed to misinformative content. We analyze human-to-LLM influence using human-stance datasets and assess LLM-to-human influence by generating LLM-based persuasive arguments. Additionally, we use a multi-agent LLM framework to analyze the spread of misinformation under persuasion among demographic-oriented LLM agents. Our findings show that demographic factors influence susceptibility to misinformation in LLMs, closely reflecting the demographic-based patterns seen in human susceptibility. We also find that, similar to human demographic groups, multi-agent LLMs exhibit echo chamber behavior. This research explores the interplay between humans and LLMs, highlighting demographic differences in the context of misinformation and offering insights for future interventions.
format Preprint
id arxiv_https___arxiv_org_abs_2503_02038
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Persuasion at Play: Understanding Misinformation Dynamics in Demographic-Aware Human-LLM Interactions
Borah, Angana
Mihalcea, Rada
Pérez-Rosas, Verónica
Computation and Language
Existing challenges in misinformation exposure and susceptibility vary across demographic groups, as some populations are more vulnerable to misinformation than others. Large language models (LLMs) introduce new dimensions to these challenges through their ability to generate persuasive content at scale and reinforcing existing biases. This study investigates the bidirectional persuasion dynamics between LLMs and humans when exposed to misinformative content. We analyze human-to-LLM influence using human-stance datasets and assess LLM-to-human influence by generating LLM-based persuasive arguments. Additionally, we use a multi-agent LLM framework to analyze the spread of misinformation under persuasion among demographic-oriented LLM agents. Our findings show that demographic factors influence susceptibility to misinformation in LLMs, closely reflecting the demographic-based patterns seen in human susceptibility. We also find that, similar to human demographic groups, multi-agent LLMs exhibit echo chamber behavior. This research explores the interplay between humans and LLMs, highlighting demographic differences in the context of misinformation and offering insights for future interventions.
title Persuasion at Play: Understanding Misinformation Dynamics in Demographic-Aware Human-LLM Interactions
topic Computation and Language
url https://arxiv.org/abs/2503.02038