Guardado en:
Detalles Bibliográficos
Autores principales: Costello, Thomas H., Pelrine, Kellin, Kowal, Matthew, Arechar, Antonio A., Godbout, Jean-François, Gleave, Adam, Rand, David, Pennycook, Gordon
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:https://arxiv.org/abs/2601.05050
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908754596855808
author Costello, Thomas H.
Pelrine, Kellin
Kowal, Matthew
Arechar, Antonio A.
Godbout, Jean-François
Gleave, Adam
Rand, David
Pennycook, Gordon
author_facet Costello, Thomas H.
Pelrine, Kellin
Kowal, Matthew
Arechar, Antonio A.
Godbout, Jean-François
Gleave, Adam
Rand, David
Pennycook, Gordon
contents Large language models (LLMs) have been shown to be persuasive across a variety of contexts. But it remains unclear whether this persuasive power advantages truth over falsehood, or if LLMs can promote misbeliefs just as easily as refuting them. Here, we investigate this question across three pre-registered experiments in which participants (N = 2,724 Americans) discussed a conspiracy theory they were uncertain about with GPT-4o, and the model was instructed to either argue against ("debunking") or for ("bunking") that conspiracy. When using a "jailbroken" GPT-4o variant with guardrails removed, the AI was as effective at increasing conspiracy belief as decreasing it. Concerningly, the bunking AI was rated more positively, and increased trust in AI, more than the debunking AI. Surprisingly, we found that using standard GPT-4o produced very similar effects, such that the guardrails imposed by OpenAI did little to prevent the LLM from promoting conspiracy beliefs. Encouragingly, however, a corrective conversation reversed these newly induced conspiracy beliefs, and simply prompting GPT-4o to only use accurate information dramatically reduced its ability to increase conspiracy beliefs. Our findings demonstrate that LLMs possess potent abilities to promote both truth and falsehood, but that potential solutions may exist to help mitigate this risk.
format Preprint
id arxiv_https___arxiv_org_abs_2601_05050
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Large language models can effectively convince people to believe conspiracies
Costello, Thomas H.
Pelrine, Kellin
Kowal, Matthew
Arechar, Antonio A.
Godbout, Jean-François
Gleave, Adam
Rand, David
Pennycook, Gordon
Artificial Intelligence
General Economics
Economics
Large language models (LLMs) have been shown to be persuasive across a variety of contexts. But it remains unclear whether this persuasive power advantages truth over falsehood, or if LLMs can promote misbeliefs just as easily as refuting them. Here, we investigate this question across three pre-registered experiments in which participants (N = 2,724 Americans) discussed a conspiracy theory they were uncertain about with GPT-4o, and the model was instructed to either argue against ("debunking") or for ("bunking") that conspiracy. When using a "jailbroken" GPT-4o variant with guardrails removed, the AI was as effective at increasing conspiracy belief as decreasing it. Concerningly, the bunking AI was rated more positively, and increased trust in AI, more than the debunking AI. Surprisingly, we found that using standard GPT-4o produced very similar effects, such that the guardrails imposed by OpenAI did little to prevent the LLM from promoting conspiracy beliefs. Encouragingly, however, a corrective conversation reversed these newly induced conspiracy beliefs, and simply prompting GPT-4o to only use accurate information dramatically reduced its ability to increase conspiracy beliefs. Our findings demonstrate that LLMs possess potent abilities to promote both truth and falsehood, but that potential solutions may exist to help mitigate this risk.
title Large language models can effectively convince people to believe conspiracies
topic Artificial Intelligence
General Economics
Economics
url https://arxiv.org/abs/2601.05050