Art-ificial Intelligence: The Effect of AI Disclosure on Evaluations of Creative Content

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Raj, Manav, Berg, Justin, Seamans, Rob
Format: Preprint
Veröffentlicht: 2023
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913403881127936
author Raj, Manav
Berg, Justin
Seamans, Rob
author_facet Raj, Manav
Berg, Justin
Seamans, Rob
contents The emergence of generative AI technologies, such as OpenAI's ChatGPT chatbot, has expanded the scope of tasks that AI tools can accomplish and enabled AI-generated creative content. In this study, we explore how disclosure regarding the use of AI in the creation of creative content affects human evaluation of such content. In a series of pre-registered experimental studies, we show that AI disclosure has no meaningful effect on evaluation either for creative or descriptive short stories, but that AI disclosure has a negative effect on evaluations for emotionally evocative poems written in the first person. We interpret this result to suggest that reactions to AI-generated content may be negative when the content is viewed as distinctly "human." We discuss the implications of this work and outline planned pathways of research to better understand whether and when AI disclosure may affect the evaluation of creative content.
format Preprint
id arxiv_https___arxiv_org_abs_2303_06217
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Art-ificial Intelligence: The Effect of AI Disclosure on Evaluations of Creative Content
Raj, Manav
Berg, Justin
Seamans, Rob
Computers and Society
General Economics
Economics
The emergence of generative AI technologies, such as OpenAI's ChatGPT chatbot, has expanded the scope of tasks that AI tools can accomplish and enabled AI-generated creative content. In this study, we explore how disclosure regarding the use of AI in the creation of creative content affects human evaluation of such content. In a series of pre-registered experimental studies, we show that AI disclosure has no meaningful effect on evaluation either for creative or descriptive short stories, but that AI disclosure has a negative effect on evaluations for emotionally evocative poems written in the first person. We interpret this result to suggest that reactions to AI-generated content may be negative when the content is viewed as distinctly "human." We discuss the implications of this work and outline planned pathways of research to better understand whether and when AI disclosure may affect the evaluation of creative content.
title Art-ificial Intelligence: The Effect of AI Disclosure on Evaluations of Creative Content
topic Computers and Society
General Economics
Economics
url https://arxiv.org/abs/2303.06217