Intersectional Unfairness Discovery

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xu, Gezheng, Chen, Qi, Ling, Charles, Wang, Boyu, Shui, Changjian
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909218993340416
author Xu, Gezheng
Chen, Qi
Ling, Charles
Wang, Boyu
Shui, Changjian
author_facet Xu, Gezheng
Chen, Qi
Ling, Charles
Wang, Boyu
Shui, Changjian
contents AI systems have been shown to produce unfair results for certain subgroups of population, highlighting the need to understand bias on certain sensitive attributes. Current research often falls short, primarily focusing on the subgroups characterized by a single sensitive attribute, while neglecting the nature of intersectional fairness of multiple sensitive attributes. This paper focuses on its one fundamental aspect by discovering diverse high-bias subgroups under intersectional sensitive attributes. Specifically, we propose a Bias-Guided Generative Network (BGGN). By treating each bias value as a reward, BGGN efficiently generates high-bias intersectional sensitive attributes. Experiments on real-world text and image datasets demonstrate a diverse and efficient discovery of BGGN. To further evaluate the generated unseen but possible unfair intersectional sensitive attributes, we formulate them as prompts and use modern generative AI to produce new texts and images. The results of frequently generating biased data provides new insights of discovering potential unfairness in popular modern generative AI systems. Warning: This paper contains generative examples that are offensive in nature.
format Preprint
id arxiv_https___arxiv_org_abs_2405_20790
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Intersectional Unfairness Discovery
Xu, Gezheng
Chen, Qi
Ling, Charles
Wang, Boyu
Shui, Changjian
Machine Learning
Computers and Society
AI systems have been shown to produce unfair results for certain subgroups of population, highlighting the need to understand bias on certain sensitive attributes. Current research often falls short, primarily focusing on the subgroups characterized by a single sensitive attribute, while neglecting the nature of intersectional fairness of multiple sensitive attributes. This paper focuses on its one fundamental aspect by discovering diverse high-bias subgroups under intersectional sensitive attributes. Specifically, we propose a Bias-Guided Generative Network (BGGN). By treating each bias value as a reward, BGGN efficiently generates high-bias intersectional sensitive attributes. Experiments on real-world text and image datasets demonstrate a diverse and efficient discovery of BGGN. To further evaluate the generated unseen but possible unfair intersectional sensitive attributes, we formulate them as prompts and use modern generative AI to produce new texts and images. The results of frequently generating biased data provides new insights of discovering potential unfairness in popular modern generative AI systems. Warning: This paper contains generative examples that are offensive in nature.
title Intersectional Unfairness Discovery
topic Machine Learning
Computers and Society
url https://arxiv.org/abs/2405.20790