Saved in:
Bibliographic Details
Main Authors: Kiden, Sarah, Peter, Oriane, Reyes-Cruz, Gisela, Klyshbekova, Maira, Choi, Sena, Bergin, Aislinn Gomez, Waheed, Maria, Eke, Damian, Azim, Tayyaba, Ramchurn, Sarvapali, Stein, Sebastian, Vallejos, Elvira Perez, Devlin, Kate, Fischer, Joel E
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.27361
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914126905737216
author Kiden, Sarah
Peter, Oriane
Reyes-Cruz, Gisela
Klyshbekova, Maira
Choi, Sena
Bergin, Aislinn Gomez
Waheed, Maria
Eke, Damian
Azim, Tayyaba
Ramchurn, Sarvapali
Stein, Sebastian
Vallejos, Elvira Perez
Devlin, Kate
Fischer, Joel E
author_facet Kiden, Sarah
Peter, Oriane
Reyes-Cruz, Gisela
Klyshbekova, Maira
Choi, Sena
Bergin, Aislinn Gomez
Waheed, Maria
Eke, Damian
Azim, Tayyaba
Ramchurn, Sarvapali
Stein, Sebastian
Vallejos, Elvira Perez
Devlin, Kate
Fischer, Joel E
contents Evidence shows that text-to-image (T2I) models disproportionately reflect Western cultural norms, amplifying misrepresentation and harms to minority groups. However, evaluating cultural sensitivity is inherently complex due to its fluid and multifaceted nature. This paper draws on a state-of-the-art review and co-creation workshops involving 59 individuals from 19 different countries. We developed and validated a mixed-methods community-based evaluation methodology to assess cultural sensitivity in T2I models, which embraces first-person methods. Quantitative scores and qualitative inquiries expose convergence and disagreement within and across communities, illuminate the downstream consequences of misrepresentation, and trace how training data shaped by unequal power relations distort depictions. Extensive assessments are constrained by high resource requirements and the dynamic nature of culture, a tension we alleviate through a context-based and iterative methodology. The paper provides actionable recommendations for stakeholders, highlighting pathways to investigate the sources, mechanisms, and impacts of cultural (mis)representation in T2I models.
format Preprint
id arxiv_https___arxiv_org_abs_2510_27361
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Back to the Communities: A Mixed-Methods and Community-Driven Evaluation of Cultural Sensitivity in Text-to-Image Models
Kiden, Sarah
Peter, Oriane
Reyes-Cruz, Gisela
Klyshbekova, Maira
Choi, Sena
Bergin, Aislinn Gomez
Waheed, Maria
Eke, Damian
Azim, Tayyaba
Ramchurn, Sarvapali
Stein, Sebastian
Vallejos, Elvira Perez
Devlin, Kate
Fischer, Joel E
Social and Information Networks
Computers and Society
Evidence shows that text-to-image (T2I) models disproportionately reflect Western cultural norms, amplifying misrepresentation and harms to minority groups. However, evaluating cultural sensitivity is inherently complex due to its fluid and multifaceted nature. This paper draws on a state-of-the-art review and co-creation workshops involving 59 individuals from 19 different countries. We developed and validated a mixed-methods community-based evaluation methodology to assess cultural sensitivity in T2I models, which embraces first-person methods. Quantitative scores and qualitative inquiries expose convergence and disagreement within and across communities, illuminate the downstream consequences of misrepresentation, and trace how training data shaped by unequal power relations distort depictions. Extensive assessments are constrained by high resource requirements and the dynamic nature of culture, a tension we alleviate through a context-based and iterative methodology. The paper provides actionable recommendations for stakeholders, highlighting pathways to investigate the sources, mechanisms, and impacts of cultural (mis)representation in T2I models.
title Back to the Communities: A Mixed-Methods and Community-Driven Evaluation of Cultural Sensitivity in Text-to-Image Models
topic Social and Information Networks
Computers and Society
url https://arxiv.org/abs/2510.27361