"Just a strange pic": Evaluating 'safety' in GenAI Image safety annotation tasks from diverse annotators' perspectives
Fuente:
arXiv
Saved in:
| Main Authors: | Wang, Ding, Díaz, Mark, Rastogi, Charvi, Davani, Aida, Prabhakaran, Vinodkumar, Mishra, Pushkar, Patel, Roma, Parrish, Alicia, Ashwood, Zoe, Paganini, Michela, Teh, Tian Huey, Rieser, Verena, Aroyo, Lora |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Whose View of Safety? A Deep DIVE Dataset for Pluralistic Alignment of Text-to-Image Models
by: Rastogi, Charvi, et al.
Published: (2025)
by: Rastogi, Charvi, et al.
Published: (2025)
Insights on Disagreement Patterns in Multimodal Safety Perception across Diverse Rater Groups
by: Rastogi, Charvi, et al.
Published: (2024)
by: Rastogi, Charvi, et al.
Published: (2024)
Decoding Safety Feedback from Diverse Raters: A Data-driven Lens on Responsiveness to Severity
by: Mishra, Pushkar, et al.
Published: (2025)
by: Mishra, Pushkar, et al.
Published: (2025)
GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectives
by: Prabhakaran, Vinodkumar, et al.
Published: (2023)
by: Prabhakaran, Vinodkumar, et al.
Published: (2023)
Humanlike AI Design Increases Anthropomorphism but Yields Divergent Outcomes on Engagement and Trust Globally
by: Schimmelpfennig, Robin, et al.
Published: (2025)
by: Schimmelpfennig, Robin, et al.
Published: (2025)
From Seed to Harvest: Augmenting Human Creativity with AI for Red-teaming Text-to-Image Models
by: Quaye, Jessica, et al.
Published: (2025)
by: Quaye, Jessica, et al.
Published: (2025)
A Comprehensive Framework to Operationalize Social Stereotypes for Responsible AI Evaluations
by: Davani, Aida, et al.
Published: (2025)
by: Davani, Aida, et al.
Published: (2025)
D3CODE: Disentangling Disagreements in Data across Cultures on Offensiveness Detection and Evaluation
by: Davani, Aida Mostafazadeh, et al.
Published: (2024)
by: Davani, Aida Mostafazadeh, et al.
Published: (2024)
Risks of Cultural Erasure in Large Language Models
by: Qadri, Rida, et al.
Published: (2025)
by: Qadri, Rida, et al.
Published: (2025)
GeniL: A Multilingual Dataset on Generalizing Language
by: Davani, Aida Mostafazadeh, et al.
Published: (2024)
by: Davani, Aida Mostafazadeh, et al.
Published: (2024)
Annotation alignment: Comparing LLM and human annotations of conversational safety
by: Movva, Rajiv, et al.
Published: (2024)
by: Movva, Rajiv, et al.
Published: (2024)
Methodologies and mechanisms for management of cumulative coastal environmental impacts. Part I: Synthesis, with annotated bibliography; Part II: Development and application of a cumulative impacts assessment protocol
by: Vestal , Barbara, et al.
Published: (1995)
by: Vestal , Barbara, et al.
Published: (1995)
annotation file
by: li, yang
Published: (2025)
by: li, yang
Published: (2025)
Ulysses annotated
by: Don Gifford
Published: (1988)
by: Don Gifford
Published: (1988)
Taxonomy of User Needs and Actions
by: Shelby, Renee, et al.
Published: (2025)
by: Shelby, Renee, et al.
Published: (2025)
Overcoming the lack of annotated medical images by non‐expert annotation?
by: Carsten M. Klingner, et al.
Published: (2024)
by: Carsten M. Klingner, et al.
Published: (2024)
Value Profiles for Encoding Human Variation
by: Sorensen, Taylor, et al.
Published: (2025)
by: Sorensen, Taylor, et al.
Published: (2025)
LLM_annotate: A Python package for annotating and analyzing fiction characters
by: Rosenbusch, Hannes
Published: (2025)
by: Rosenbusch, Hannes
Published: (2025)
Adversarial Nibbler: An Open Red-Teaming Method for Identifying Diverse Harms in Text-to-Image Generation
by: Quaye, Jessica, et al.
Published: (2024)
by: Quaye, Jessica, et al.
Published: (2024)
An annotated bibliography of Sirenia
by: Whitfield, Jr., William K., et al.
Published: (1975)
by: Whitfield, Jr., William K., et al.
Published: (1975)
Chapter An experimental annotation task to investigate annotators’ subjectivity in a Misogyny dataset
by: Tontodimamma, Alice, et al.
Published: (2023)
by: Tontodimamma, Alice, et al.
Published: (2023)
Multi-turn Evaluation of Anthropomorphic Behaviours in Large Language Models
by: Ibrahim, Lujain, et al.
Published: (2025)
by: Ibrahim, Lujain, et al.
Published: (2025)
Redox Reactions of [RuIII(pic)3] (pic−=picolinate) with Sulfite in Aqueous Solution: Kinetic, and Mechanistic Studies
by: Olga Impert, et al.
Published: (2024)
by: Olga Impert, et al.
Published: (2024)
Going PLACES: Participatory Localized Red Teaming for Text-to-Image Safety in the Global South
by: Rastogi, Charvi, et al.
Published: (2026)
by: Rastogi, Charvi, et al.
Published: (2026)
Naganishia friedmannii Genome annotation
by: Vimercati, Lara
Published: (2025)
by: Vimercati, Lara
Published: (2025)
Dermacentor reticulatus genome and annotation
by: Kostarnoy, Alexey, et al.
Published: (2026)
by: Kostarnoy, Alexey, et al.
Published: (2026)
Semantic segmentation with coarse annotations
by: de Jong, Jort, et al.
Published: (2025)
by: de Jong, Jort, et al.
Published: (2025)
Plant genome assembly and annotation.
by: Michael, Todd P
Published: (2026)
by: Michael, Todd P
Published: (2026)
An annotated checklist of the cladocera of Cuba
by: Gutiérrez, M.E., et al.
Published: (2008)
by: Gutiérrez, M.E., et al.
Published: (2008)
An annotated checklist of the mammals of Paraguay
by: NOÉ U. DE LA SANCHA
Published: (2017)
by: NOÉ U. DE LA SANCHA
Published: (2017)
Methodological approach for pragmatic annotation
by: Javier Calle
Published: (2008)
by: Javier Calle
Published: (2008)
Ensemble lagged forecasts of a monsoon depression over India using a mesoscale model
by: Vinodkumar Vinodkumar
Published: (2007)
by: Vinodkumar Vinodkumar
Published: (2007)
Bayesian Active Learning for Discrete Latent Variable Models
by: Jha, Aditi, et al.
Published: (2022)
by: Jha, Aditi, et al.
Published: (2022)
An annotated list of Gainesville, Florida, Coleoptera
by: Dozier, Herbert L. (Herbert Lawrence)
Published: (1918)
by: Dozier, Herbert L. (Herbert Lawrence)
Published: (1918)
CSANNO - a molecular activity annotator
by: Falcao, Andre O.
Published: (2026)
by: Falcao, Andre O.
Published: (2026)
Reducing annotator bias by belief elicitation
by: Jakobsen, Terne Sasha Thorn, et al.
Published: (2024)
by: Jakobsen, Terne Sasha Thorn, et al.
Published: (2024)
Homologous nodes in annotated complex networks
by: Moon, Sung Soo, et al.
Published: (2025)
by: Moon, Sung Soo, et al.
Published: (2025)
Quickly excluding an annotated planar graph
by: Gorsky, Maximilian, et al.
Published: (2026)
by: Gorsky, Maximilian, et al.
Published: (2026)
Automation of functional annotation of genomes and transcriptomes
by: Luis Fernando Cadavid Gutiérrez
Published: (2014)
by: Luis Fernando Cadavid Gutiérrez
Published: (2014)
An annotated checklist of freshwater fishes of Armenia
by: Gabrielyan, B.K.
Published: (2001)
by: Gabrielyan, B.K.
Published: (2001)
Similar Items
-
Whose View of Safety? A Deep DIVE Dataset for Pluralistic Alignment of Text-to-Image Models
by: Rastogi, Charvi, et al.
Published: (2025) -
Insights on Disagreement Patterns in Multimodal Safety Perception across Diverse Rater Groups
by: Rastogi, Charvi, et al.
Published: (2024) -
Decoding Safety Feedback from Diverse Raters: A Data-driven Lens on Responsiveness to Severity
by: Mishra, Pushkar, et al.
Published: (2025) -
GRASP: A Disagreement Analysis Framework to Assess Group Associations in Perspectives
by: Prabhakaran, Vinodkumar, et al.
Published: (2023) -
Humanlike AI Design Increases Anthropomorphism but Yields Divergent Outcomes on Engagement and Trust Globally
by: Schimmelpfennig, Robin, et al.
Published: (2025)