BiasConnect: Investigating Bias Interactions in Text-to-Image Models

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Shukla, Pushkar, Chinchure, Aditya, Diana, Emily, Tolbert, Alexander, Hosanagar, Kartik, Balasubramanian, Vineeth N., Sigal, Leonid, Turk, Matthew A.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866915195357495296
author Shukla, Pushkar
Chinchure, Aditya
Diana, Emily
Tolbert, Alexander
Hosanagar, Kartik
Balasubramanian, Vineeth N.
Sigal, Leonid
Turk, Matthew A.
author_facet Shukla, Pushkar
Chinchure, Aditya
Diana, Emily
Tolbert, Alexander
Hosanagar, Kartik
Balasubramanian, Vineeth N.
Sigal, Leonid
Turk, Matthew A.
contents The biases exhibited by Text-to-Image (TTI) models are often treated as if they are independent, but in reality, they may be deeply interrelated. Addressing bias along one dimension, such as ethnicity or age, can inadvertently influence another dimension, like gender, either mitigating or exacerbating existing disparities. Understanding these interdependencies is crucial for designing fairer generative models, yet measuring such effects quantitatively remains a challenge. In this paper, we aim to address these questions by introducing BiasConnect, a novel tool designed to analyze and quantify bias interactions in TTI models. Our approach leverages a counterfactual-based framework to generate pairwise causal graphs that reveals the underlying structure of bias interactions for the given text prompt. Additionally, our method provides empirical estimates that indicate how other bias dimensions shift toward or away from an ideal distribution when a given bias is modified. Our estimates have a strong correlation (+0.69) with the interdependency observations post bias mitigation. We demonstrate the utility of BiasConnect for selecting optimal bias mitigation axes, comparing different TTI models on the dependencies they learn, and understanding the amplification of intersectional societal biases in TTI models.
format Preprint
id arxiv_https___arxiv_org_abs_2503_09763
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle BiasConnect: Investigating Bias Interactions in Text-to-Image Models
Shukla, Pushkar
Chinchure, Aditya
Diana, Emily
Tolbert, Alexander
Hosanagar, Kartik
Balasubramanian, Vineeth N.
Sigal, Leonid
Turk, Matthew A.
Computer Vision and Pattern Recognition
Computation and Language
Machine Learning
The biases exhibited by Text-to-Image (TTI) models are often treated as if they are independent, but in reality, they may be deeply interrelated. Addressing bias along one dimension, such as ethnicity or age, can inadvertently influence another dimension, like gender, either mitigating or exacerbating existing disparities. Understanding these interdependencies is crucial for designing fairer generative models, yet measuring such effects quantitatively remains a challenge. In this paper, we aim to address these questions by introducing BiasConnect, a novel tool designed to analyze and quantify bias interactions in TTI models. Our approach leverages a counterfactual-based framework to generate pairwise causal graphs that reveals the underlying structure of bias interactions for the given text prompt. Additionally, our method provides empirical estimates that indicate how other bias dimensions shift toward or away from an ideal distribution when a given bias is modified. Our estimates have a strong correlation (+0.69) with the interdependency observations post bias mitigation. We demonstrate the utility of BiasConnect for selecting optimal bias mitigation axes, comparing different TTI models on the dependencies they learn, and understanding the amplification of intersectional societal biases in TTI models.
title BiasConnect: Investigating Bias Interactions in Text-to-Image Models
topic Computer Vision and Pattern Recognition
Computation and Language
Machine Learning
url https://arxiv.org/abs/2503.09763