Stable Diffusion Exposed: Gender Bias from Prompt to Image

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Wu, Yankun, Nakashima, Yuta, Garcia, Noa
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911983394095104
author Wu, Yankun
Nakashima, Yuta
Garcia, Noa
author_facet Wu, Yankun
Nakashima, Yuta
Garcia, Noa
contents Several studies have raised awareness about social biases in image generative models, demonstrating their predisposition towards stereotypes and imbalances. This paper contributes to this growing body of research by introducing an evaluation protocol that analyzes the impact of gender indicators at every step of the generation process on Stable Diffusion images. Leveraging insights from prior work, we explore how gender indicators not only affect gender presentation but also the representation of objects and layouts within the generated images. Our findings include the existence of differences in the depiction of objects, such as instruments tailored for specific genders, and shifts in overall layouts. We also reveal that neutral prompts tend to produce images more aligned with masculine prompts than their feminine counterparts. We further explore where bias originates through representational disparities and how it manifests in the images via prompt-image dependencies, and provide recommendations for developers and users to mitigate potential bias in image generation.
format Preprint
id arxiv_https___arxiv_org_abs_2312_03027
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Stable Diffusion Exposed: Gender Bias from Prompt to Image
Wu, Yankun
Nakashima, Yuta
Garcia, Noa
Computer Vision and Pattern Recognition
Several studies have raised awareness about social biases in image generative models, demonstrating their predisposition towards stereotypes and imbalances. This paper contributes to this growing body of research by introducing an evaluation protocol that analyzes the impact of gender indicators at every step of the generation process on Stable Diffusion images. Leveraging insights from prior work, we explore how gender indicators not only affect gender presentation but also the representation of objects and layouts within the generated images. Our findings include the existence of differences in the depiction of objects, such as instruments tailored for specific genders, and shifts in overall layouts. We also reveal that neutral prompts tend to produce images more aligned with masculine prompts than their feminine counterparts. We further explore where bias originates through representational disparities and how it manifests in the images via prompt-image dependencies, and provide recommendations for developers and users to mitigate potential bias in image generation.
title Stable Diffusion Exposed: Gender Bias from Prompt to Image
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2312.03027