"There Has To Be a Lot That We're Missing": Moderating AI-Generated Content on Reddit

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lloyd, Travis, Reagle, Joseph, Naaman, Mor
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911218569052160
author Lloyd, Travis
Reagle, Joseph
Naaman, Mor
author_facet Lloyd, Travis
Reagle, Joseph
Naaman, Mor
contents Generative AI is altering how we work, learn, communicate, and participate in online communities. How might online communities be changed by generative AI? To start addressing this question, we focused on online community moderators' experiences with AI-generated content (AIGC). We performed fifteen in-depth, semi-structured interviews with moderators of Reddit communities that restrict the use of AIGC. Our study finds that rules about AIGC are motivated by concerns about content quality, social dynamics, and governance challenges. Moderators fear that, without such rules, AIGC threatens to reduce their communities' utility and social value. We find that, despite the absence of robust tools for detecting AIGC, moderators were able to somewhat limit the disruption it caused by working with their communities to clarify norms. However, moderators found enforcing AIGC restrictions challenging, as they rely on time-intensive and inaccurate detection heuristics. Our results highlight the importance of supporting community autonomy and self-determination in the face of this sudden technological change, and suggest potential design solutions that may help.
format Preprint
id arxiv_https___arxiv_org_abs_2311_12702
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle "There Has To Be a Lot That We're Missing": Moderating AI-Generated Content on Reddit
Lloyd, Travis
Reagle, Joseph
Naaman, Mor
Computers and Society
Social and Information Networks
Generative AI is altering how we work, learn, communicate, and participate in online communities. How might online communities be changed by generative AI? To start addressing this question, we focused on online community moderators' experiences with AI-generated content (AIGC). We performed fifteen in-depth, semi-structured interviews with moderators of Reddit communities that restrict the use of AIGC. Our study finds that rules about AIGC are motivated by concerns about content quality, social dynamics, and governance challenges. Moderators fear that, without such rules, AIGC threatens to reduce their communities' utility and social value. We find that, despite the absence of robust tools for detecting AIGC, moderators were able to somewhat limit the disruption it caused by working with their communities to clarify norms. However, moderators found enforcing AIGC restrictions challenging, as they rely on time-intensive and inaccurate detection heuristics. Our results highlight the importance of supporting community autonomy and self-determination in the face of this sudden technological change, and suggest potential design solutions that may help.
title "There Has To Be a Lot That We're Missing": Moderating AI-Generated Content on Reddit
topic Computers and Society
Social and Information Networks
url https://arxiv.org/abs/2311.12702