The Influencer Next Door: How Misinformation Creators Use GenAI

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hassoun, Amelia, Abonizio, Ariel, Osborn, Katy, Wu, Cameron, Goldberg, Beth
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929390815805440
author Hassoun, Amelia
Abonizio, Ariel
Osborn, Katy
Wu, Cameron
Goldberg, Beth
author_facet Hassoun, Amelia
Abonizio, Ariel
Osborn, Katy
Wu, Cameron
Goldberg, Beth
contents Advances in generative AI (GenAI) have raised concerns about detecting and discerning AI-generated content from human-generated content. Most existing literature assumes a paradigm where 'expert' organized disinformation creators and flawed AI models deceive 'ordinary' users. Based on longitudinal ethnographic research with misinformation creators and consumers between 2022-2023, we instead find that GenAI supports bricolage work, where non-experts increasingly use GenAI to remix, repackage, and (re)produce content to meet their personal needs and desires. This research yielded four key findings: First, participants primarily used GenAI for creation, rather than truth-seeking. Second, a spreading 'influencer millionaire' narrative drove participants to become content creators, using GenAI as a productivity tool to generate a volume of (often misinformative) content. Third, GenAI lowered the barrier to entry for content creation across modalities, enticing consumers to become creators and significantly increasing existing creators' output. Finally, participants used Gen AI to learn and deploy marketing tactics to expand engagement and monetize their content. We argue for shifting analysis from the public as consumers of AI content to bricoleurs who use GenAI creatively, often without a detailed understanding of its underlying technology. We analyze how these understudied emergent uses of GenAI produce new or accelerated misinformation harms, and their implications for AI products, platforms and policies.
format Preprint
id arxiv_https___arxiv_org_abs_2405_13554
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle The Influencer Next Door: How Misinformation Creators Use GenAI
Hassoun, Amelia
Abonizio, Ariel
Osborn, Katy
Wu, Cameron
Goldberg, Beth
Human-Computer Interaction
Artificial Intelligence
Advances in generative AI (GenAI) have raised concerns about detecting and discerning AI-generated content from human-generated content. Most existing literature assumes a paradigm where 'expert' organized disinformation creators and flawed AI models deceive 'ordinary' users. Based on longitudinal ethnographic research with misinformation creators and consumers between 2022-2023, we instead find that GenAI supports bricolage work, where non-experts increasingly use GenAI to remix, repackage, and (re)produce content to meet their personal needs and desires. This research yielded four key findings: First, participants primarily used GenAI for creation, rather than truth-seeking. Second, a spreading 'influencer millionaire' narrative drove participants to become content creators, using GenAI as a productivity tool to generate a volume of (often misinformative) content. Third, GenAI lowered the barrier to entry for content creation across modalities, enticing consumers to become creators and significantly increasing existing creators' output. Finally, participants used Gen AI to learn and deploy marketing tactics to expand engagement and monetize their content. We argue for shifting analysis from the public as consumers of AI content to bricoleurs who use GenAI creatively, often without a detailed understanding of its underlying technology. We analyze how these understudied emergent uses of GenAI produce new or accelerated misinformation harms, and their implications for AI products, platforms and policies.
title The Influencer Next Door: How Misinformation Creators Use GenAI
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2405.13554