Conversational AI increases political knowledge as effectively as self-directed internet search

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Luettgau, Lennart, Kirk, Hannah Rose, Hackenburg, Kobi, Bergs, Jessica, Davidson, Henry, Ogden, Henry, Siddarth, Divya, Huang, Saffron, Summerfield, Christopher
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913046696296448
author Luettgau, Lennart
Kirk, Hannah Rose
Hackenburg, Kobi
Bergs, Jessica
Davidson, Henry
Ogden, Henry
Siddarth, Divya
Huang, Saffron
Summerfield, Christopher
author_facet Luettgau, Lennart
Kirk, Hannah Rose
Hackenburg, Kobi
Bergs, Jessica
Davidson, Henry
Ogden, Henry
Siddarth, Divya
Huang, Saffron
Summerfield, Christopher
contents Conversational AI systems are increasingly being used in place of traditional search engines to help users complete information-seeking tasks. This has raised concerns in the political domain, where biased or hallucinated outputs could misinform voters or distort public opinion. However, in spite of these concerns, the extent to which conversational AI is used for political information-seeking, as well the potential impact of this use on users' political knowledge, remains uncertain. Here, we address these questions: First, in a representative national survey of the UK public (N = 2,499), we find that in the week before the 2024 election as many as 32% of chatbot users - and 13% of eligible UK voters - have used conversational AI to seek political information relevant to their electoral choice. Second, in a series of randomised controlled trials (N = 2,858 total) we find that across issues, models, and prompting strategies, task-directed conversations with AI to research specific political topics increase political knowledge (increase belief in true information and decrease belief in misinformation) to the same extent as self-directed Google search. Taken together, our results suggest that people in the UK are increasingly turning to conversational AI for information about politics. These findings substantially extend prior work by demonstrating that conversational AI's effects on political knowledge generalise across multiple topics, political perspectives, and model families, suggesting that the shift toward AI-assisted political information-seeking may not lead to increased public belief in political misinformation.
format Preprint
id arxiv_https___arxiv_org_abs_2509_05219
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Conversational AI increases political knowledge as effectively as self-directed internet search
Luettgau, Lennart
Kirk, Hannah Rose
Hackenburg, Kobi
Bergs, Jessica
Davidson, Henry
Ogden, Henry
Siddarth, Divya
Huang, Saffron
Summerfield, Christopher
Human-Computer Interaction
Conversational AI systems are increasingly being used in place of traditional search engines to help users complete information-seeking tasks. This has raised concerns in the political domain, where biased or hallucinated outputs could misinform voters or distort public opinion. However, in spite of these concerns, the extent to which conversational AI is used for political information-seeking, as well the potential impact of this use on users' political knowledge, remains uncertain. Here, we address these questions: First, in a representative national survey of the UK public (N = 2,499), we find that in the week before the 2024 election as many as 32% of chatbot users - and 13% of eligible UK voters - have used conversational AI to seek political information relevant to their electoral choice. Second, in a series of randomised controlled trials (N = 2,858 total) we find that across issues, models, and prompting strategies, task-directed conversations with AI to research specific political topics increase political knowledge (increase belief in true information and decrease belief in misinformation) to the same extent as self-directed Google search. Taken together, our results suggest that people in the UK are increasingly turning to conversational AI for information about politics. These findings substantially extend prior work by demonstrating that conversational AI's effects on political knowledge generalise across multiple topics, political perspectives, and model families, suggesting that the shift toward AI-assisted political information-seeking may not lead to increased public belief in political misinformation.
title Conversational AI increases political knowledge as effectively as self-directed internet search
topic Human-Computer Interaction
url https://arxiv.org/abs/2509.05219