Cover Image

"I Cannot Write This Because It Violates Our Content Policy": Understanding Content Moderation Policies and User Experiences in Generative AI Products

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Gao, Lan, Chen, Oscar, Lee, Rachel, Feamster, Nick, Tan, Chenhao, Chetty, Marshini
Format:	Preprint
Published:	2025
Subjects:	Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Governance of AI-Generated Content: A Case Study on Social Media Platforms
by: Gao, Lan, et al.
Published: (2026)

"Community Guidelines Make this the Best Party on the Internet": An In-Depth Study of Online Platforms' Content Moderation Policies
by: Schaffner, Brennan, et al.
Published: (2024)

Measuring Compliance with the California Consumer Privacy Act Over Space and Time
by: Tran, Van, et al.
Published: (2024)

A Systematic Review of User Experiments Measuring the Effects of Dark Patterns
by: Schaffner, Brennan, et al.
Published: (2026)

Dark Patterns in the Opt-Out Process and Compliance with the California Consumer Privacy Act (CCPA)
by: Tran, Van Hong, et al.
Published: (2024)

Generative AI Uses and Risks for Knowledge Workers in a Science Organization
by: Wagman, Kelly B., et al.
Published: (2025)

Creating and Evaluating Privacy and Security Micro-Lessons for Elementary School Children
by: Gao, Lan, et al.
Published: (2025)

Designing and Testing a Mobile Application for Collecting WhatsApp Chat Data While Preserving Privacy
by: Schaffner, Brennan, et al.
Published: (2024)

An Experimental Study Of Netflix Use and the Effects of Autoplay on Watching Behaviors
by: Schaffner, Brennan, et al.
Published: (2024)

"It's OK Because...": The Wild West of Student Rationalization of AI Use in Academic Writing
by: Kim, Jiyoon, et al.
Published: (2026)

Personalizing Content Moderation on Social Media: User Perspectives on Moderation Choices, Interface Design, and Labor
by: Jhaver, Shagun, et al.
Published: (2023)

Content Moderation Futures
by: Blackwell, Lindsay
Published: (2025)

Beyond PII: How Users Attempt to Estimate and Mitigate Implicit LLM Inference
by: Wang, Synthia, et al.
Published: (2025)

Measuring the Consolidation of DNS and Web Hosting Providers
by: Wang, Synthia, et al.
Published: (2021)

AI Content Moderation in Therapy Conversations
by: Kim, Jiwon, et al.
Published: (2026)

I've Seen Enough: Measuring the Toll of Content Moderation on Mental Health
by: Gauthier, Gabrielle M, et al.
Published: (2025)

Identity-related Speech Suppression in Generative AI Content Moderation
by: Proebsting, Grace, et al.
Published: (2024)

End User Authoring of Personalized Content Classifiers: Comparing Example Labeling, Rule Writing, and LLM Prompting
by: Wang, Leijie, et al.
Published: (2024)

HateBuffer: Safeguarding Content Moderators' Mental Well-Being through Hate Speech Content Modification
by: Park, Subin, et al.
Published: (2025)

Understanding the Video Content Creation Journey of Creators with Sensory Impairment in Kenya
by: Xiao, Lan, et al.
Published: (2025)

Should AI Mimic People? Understanding AI-Supported Writing Technology Among Black Users
by: Basoah, Jeffrey, et al.
Published: (2025)

Designing Child-Centered Content Exposure and Moderation
by: Saldías, Belén
Published: (2024)

Leveraging AI to Generate Audio for User-generated Content in Video Games
by: Marrinan, Thomas, et al.
Published: (2024)

Why am I seeing this: Democratizing End User Auditing for Online Content Recommendations
by: Chen, Chaoran, et al.
Published: (2024)

Cleaning Up the Streets: Understanding Motivations, Mental Models, and Concerns of Users Flagging Social Media Content
by: Zhang, Alice Qian, et al.
Published: (2023)

"I Got Flagged for Supposed Bullying, Even Though It Was in Response to Someone Harassing Me About My Disability.": A Study of Blind TikTokers' Content Moderation Experiences
by: Lyu, Yao, et al.
Published: (2024)

A Vision for AI-Driven Adaptation of Dynamic AR Content to Users and Environments
by: Rasch, Julian, et al.
Published: (2025)

AURA: Amplifying Understanding, Resilience, and Awareness for Responsible AI Content Work
by: Zhang, Alice Qian, et al.
Published: (2024)

What If Moderation Didn't Mean Suppression? A Case for Personalized Content Transformation
by: Rashed, Rayhan, et al.
Published: (2025)

Users Favor LLM-Generated Content -- Until They Know It's AI
by: Parshakov, Petr, et al.
Published: (2025)

AI vs. Human Judgment of Content Moderation: LLM-as-a-Judge and Ethics-Based Response Refusals
by: Pasch, Stefan
Published: (2025)

Longitudinal Monitoring of LLM Content Moderation of Social Issues
by: Dai, Yunlang, et al.
Published: (2025)

The Hidden Language of Harm: Examining the Role of Emojis in Harmful Online Communication and Content Moderation
by: Zhou, Yuhang, et al.
Published: (2025)

Content Moderation in TV Search: Balancing Policy Compliance, Relevance, and User Experience
by: Hande, Adeep, et al.
Published: (2025)

GhostWriter: Augmenting Collaborative Human-AI Writing Experiences Through Personalization and Agency
by: Yeh, Catherine, et al.
Published: (2024)

Examining the Impact of Label Detail and Content Stakes on User Perceptions of AI-Generated Images on Social Media
by: Chen, Jingruo, et al.
Published: (2025)

LLM Content Moderation and User Satisfaction: Evidence from Response Refusals in Chatbot Arena
by: Pasch, Stefan
Published: (2025)

Promptimizer: User-Led Prompt Optimization for Personal Content Classification
by: Wang, Leijie, et al.
Published: (2025)

Beyond Content Exposure: Systemic Factors Driving Moderators' Mental Health Crisis in Africa
by: Abdelkadir, Nuredin Ali, et al.
Published: (2026)

"It's Great Because It's Ran By Us": Empowering Teen Volunteer Discord Moderators to Design Healthy and Engaging Youth-Led Online Communities
by: Yoon, Jina, et al.
Published: (2025)