Homogenization Effects of Large Language Models on Human Creative Ideation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Anderson, Barrett R., Shah, Jash Hemant, Kreminski, Max
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910442601840640
author Anderson, Barrett R.
Shah, Jash Hemant
Kreminski, Max
author_facet Anderson, Barrett R.
Shah, Jash Hemant
Kreminski, Max
contents Large language models (LLMs) are now being used in a wide variety of contexts, including as creativity support tools (CSTs) intended to help their users come up with new ideas. But do LLMs actually support user creativity? We hypothesized that the use of an LLM as a CST might make the LLM's users feel more creative, and even broaden the range of ideas suggested by each individual user, but also homogenize the ideas suggested by different users. We conducted a 36-participant comparative user study and found, in accordance with the homogenization hypothesis, that different users tended to produce less semantically distinct ideas with ChatGPT than with an alternative CST. Additionally, ChatGPT users generated a greater number of more detailed ideas, but felt less responsible for the ideas they generated. We discuss potential implications of these findings for users, designers, and developers of LLM-based CSTs.
format Preprint
id arxiv_https___arxiv_org_abs_2402_01536
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Homogenization Effects of Large Language Models on Human Creative Ideation
Anderson, Barrett R.
Shah, Jash Hemant
Kreminski, Max
Human-Computer Interaction
Artificial Intelligence
Large language models (LLMs) are now being used in a wide variety of contexts, including as creativity support tools (CSTs) intended to help their users come up with new ideas. But do LLMs actually support user creativity? We hypothesized that the use of an LLM as a CST might make the LLM's users feel more creative, and even broaden the range of ideas suggested by each individual user, but also homogenize the ideas suggested by different users. We conducted a 36-participant comparative user study and found, in accordance with the homogenization hypothesis, that different users tended to produce less semantically distinct ideas with ChatGPT than with an alternative CST. Additionally, ChatGPT users generated a greater number of more detailed ideas, but felt less responsible for the ideas they generated. We discuss potential implications of these findings for users, designers, and developers of LLM-based CSTs.
title Homogenization Effects of Large Language Models on Human Creative Ideation
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2402.01536