AI model GPT-3 (dis)informs us better than humans

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Spitale, Giovanni, Biller-Andorno, Nikola, Germani, Federico
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910354456444928
author Spitale, Giovanni
Biller-Andorno, Nikola
Germani, Federico
author_facet Spitale, Giovanni
Biller-Andorno, Nikola
Germani, Federico
contents Artificial intelligence is changing the way we create and evaluate information, and this is happening during an infodemic, which has been having dramatic effects on global health. In this paper we evaluate whether recruited individuals can distinguish disinformation from accurate information, structured in the form of tweets, and determine whether a tweet is organic or synthetic, i.e., whether it has been written by a Twitter user or by the AI model GPT-3. Our results show that GPT-3 is a double-edge sword, which, in comparison with humans, can produce accurate information that is easier to understand, but can also produce more compelling disinformation. We also show that humans cannot distinguish tweets generated by GPT-3 from tweets written by human users. Starting from our results, we reflect on the dangers of AI for disinformation, and on how we can improve information campaigns to benefit global health.
format Preprint
id arxiv_https___arxiv_org_abs_2301_11924
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle AI model GPT-3 (dis)informs us better than humans
Spitale, Giovanni
Biller-Andorno, Nikola
Germani, Federico
Computers and Society
Artificial Intelligence
Human-Computer Interaction
Artificial intelligence is changing the way we create and evaluate information, and this is happening during an infodemic, which has been having dramatic effects on global health. In this paper we evaluate whether recruited individuals can distinguish disinformation from accurate information, structured in the form of tweets, and determine whether a tweet is organic or synthetic, i.e., whether it has been written by a Twitter user or by the AI model GPT-3. Our results show that GPT-3 is a double-edge sword, which, in comparison with humans, can produce accurate information that is easier to understand, but can also produce more compelling disinformation. We also show that humans cannot distinguish tweets generated by GPT-3 from tweets written by human users. Starting from our results, we reflect on the dangers of AI for disinformation, and on how we can improve information campaigns to benefit global health.
title AI model GPT-3 (dis)informs us better than humans
topic Computers and Society
Artificial Intelligence
Human-Computer Interaction
url https://arxiv.org/abs/2301.11924