Saved in:
Bibliographic Details
Main Authors: Herbold, Steffen, Trautsch, Alexander, Kikteva, Zlata, Hautli-Janisz, Annette
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2407.12855
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929425307664384
author Herbold, Steffen
Trautsch, Alexander
Kikteva, Zlata
Hautli-Janisz, Annette
author_facet Herbold, Steffen
Trautsch, Alexander
Kikteva, Zlata
Hautli-Janisz, Annette
contents Modern AI technology like Large language models (LLMs) has the potential to pollute the public information sphere with made-up content, which poses a significant threat to the cohesion of societies at large. A wide range of research has shown that LLMs are capable of generating text of impressive quality, including persuasive political speech, text with a pre-defined style, and role-specific content. But there is a crucial gap in the literature: We lack large-scale and systematic studies of how capable LLMs are in impersonating political and societal representatives and how the general public judges these impersonations in terms of authenticity, relevance and coherence. We present the results of a study based on a cross-section of British society that shows that LLMs are able to generate responses to debate questions that were part of a broadcast political debate programme in the UK. The impersonated responses are judged to be more authentic and relevant than the original responses given by people who were impersonated. This shows two things: (1) LLMs can be made to contribute meaningfully to the public political debate and (2) there is a dire need to inform the general public of the potential harm this can have on society.
format Preprint
id arxiv_https___arxiv_org_abs_2407_12855
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Large Language Models can impersonate politicians and other public figures
Herbold, Steffen
Trautsch, Alexander
Kikteva, Zlata
Hautli-Janisz, Annette
Computation and Language
Artificial Intelligence
Machine Learning
Modern AI technology like Large language models (LLMs) has the potential to pollute the public information sphere with made-up content, which poses a significant threat to the cohesion of societies at large. A wide range of research has shown that LLMs are capable of generating text of impressive quality, including persuasive political speech, text with a pre-defined style, and role-specific content. But there is a crucial gap in the literature: We lack large-scale and systematic studies of how capable LLMs are in impersonating political and societal representatives and how the general public judges these impersonations in terms of authenticity, relevance and coherence. We present the results of a study based on a cross-section of British society that shows that LLMs are able to generate responses to debate questions that were part of a broadcast political debate programme in the UK. The impersonated responses are judged to be more authentic and relevant than the original responses given by people who were impersonated. This shows two things: (1) LLMs can be made to contribute meaningfully to the public political debate and (2) there is a dire need to inform the general public of the potential harm this can have on society.
title Large Language Models can impersonate politicians and other public figures
topic Computation and Language
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2407.12855