Worker Discretion Advised: Co-designing Risk Disclosure in Crowdsourced Responsible AI (RAI) Content Work

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Qian, Alice, Yang, Ziqi, Shaw, Ryland, Suh, Jina, Dabbish, Laura, Shen, Hong
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915903817383936
author Qian, Alice
Yang, Ziqi
Shaw, Ryland
Suh, Jina
Dabbish, Laura
Shen, Hong
author_facet Qian, Alice
Yang, Ziqi
Shaw, Ryland
Suh, Jina
Dabbish, Laura
Shen, Hong
contents Responsible AI (RAI) content work, such as annotation, moderation, or red teaming for AI safety, often exposes crowd workers to potentially harmful content. While prior work has underscored the importance of communicating well-being risk to employed content moderators, designing effective disclosure mechanisms for crowd workers while balancing worker protection with the needs of task designers and platforms remains largely unexamined. To address this gap, we conducted individual co-design sessions with 15 task designers, 11 crowdworkers, and 3 platform representatives. We investigated task designer preferences for support in disclosing tasks, worker preferences for receiving risk disclosure warnings, and how platform representatives envision their role in shaping risk disclosure practices. We identify design tensions and map the sociotechnical tradeoffs that shape disclosure practices. We contribute design recommendations and feature concepts for risk disclosure mechanisms in the context of RAI content work.
format Preprint
id arxiv_https___arxiv_org_abs_2509_12140
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Worker Discretion Advised: Co-designing Risk Disclosure in Crowdsourced Responsible AI (RAI) Content Work
Qian, Alice
Yang, Ziqi
Shaw, Ryland
Suh, Jina
Dabbish, Laura
Shen, Hong
Human-Computer Interaction
Computers and Society
Responsible AI (RAI) content work, such as annotation, moderation, or red teaming for AI safety, often exposes crowd workers to potentially harmful content. While prior work has underscored the importance of communicating well-being risk to employed content moderators, designing effective disclosure mechanisms for crowd workers while balancing worker protection with the needs of task designers and platforms remains largely unexamined. To address this gap, we conducted individual co-design sessions with 15 task designers, 11 crowdworkers, and 3 platform representatives. We investigated task designer preferences for support in disclosing tasks, worker preferences for receiving risk disclosure warnings, and how platform representatives envision their role in shaping risk disclosure practices. We identify design tensions and map the sociotechnical tradeoffs that shape disclosure practices. We contribute design recommendations and feature concepts for risk disclosure mechanisms in the context of RAI content work.
title Worker Discretion Advised: Co-designing Risk Disclosure in Crowdsourced Responsible AI (RAI) Content Work
topic Human-Computer Interaction
Computers and Society
url https://arxiv.org/abs/2509.12140