On Demographic Group Fairness Guarantees in Deep Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Luo, Yan, Wen, Congcong, Shi, Min, Huang, Hao, Fang, Yi, Wang, Mengyu
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915823749169152
author Luo, Yan
Wen, Congcong
Shi, Min
Huang, Hao
Fang, Yi
Wang, Mengyu
author_facet Luo, Yan
Wen, Congcong
Shi, Min
Huang, Hao
Fang, Yi
Wang, Mengyu
contents We present a theoretical framework analyzing the relationship between data distributions and fairness guarantees in equitable deep learning. We establish novel bounds that account for distribution heterogeneity across demographic groups, deriving fairness error and convergence rate bounds that characterize how distributional differences affect the fairness-accuracy trade-off. Extensive experiments across diverse modalities, including FairVision, CheXpert, HAM10000, FairFace, ACS Income, and CivilComments-WILDS, validate our theoretical findings, demonstrating that feature distribution differences across demographic groups significantly impact model fairness, with disparities particularly pronounced in racial categories. Motivated by these insights, we propose Fairness-Aware Regularization (FAR), a practical training objective that minimizes inter-group discrepancies in feature centroids and covariances. FAR consistently improves overall AUC, ES-AUC, and subgroup performance across all datasets. Our work advances the theoretical understanding of fairness in AI systems and provides a foundation for developing more equitable algorithms. The code for analysis is publicly available at https://github.com/Harvard-AI-and-Robotics-Lab/FairnessGuarantee.
format Preprint
id arxiv_https___arxiv_org_abs_2412_20377
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle On Demographic Group Fairness Guarantees in Deep Learning
Luo, Yan
Wen, Congcong
Shi, Min
Huang, Hao
Fang, Yi
Wang, Mengyu
Machine Learning
Computers and Society
We present a theoretical framework analyzing the relationship between data distributions and fairness guarantees in equitable deep learning. We establish novel bounds that account for distribution heterogeneity across demographic groups, deriving fairness error and convergence rate bounds that characterize how distributional differences affect the fairness-accuracy trade-off. Extensive experiments across diverse modalities, including FairVision, CheXpert, HAM10000, FairFace, ACS Income, and CivilComments-WILDS, validate our theoretical findings, demonstrating that feature distribution differences across demographic groups significantly impact model fairness, with disparities particularly pronounced in racial categories. Motivated by these insights, we propose Fairness-Aware Regularization (FAR), a practical training objective that minimizes inter-group discrepancies in feature centroids and covariances. FAR consistently improves overall AUC, ES-AUC, and subgroup performance across all datasets. Our work advances the theoretical understanding of fairness in AI systems and provides a foundation for developing more equitable algorithms. The code for analysis is publicly available at https://github.com/Harvard-AI-and-Robotics-Lab/FairnessGuarantee.
title On Demographic Group Fairness Guarantees in Deep Learning
topic Machine Learning
Computers and Society
url https://arxiv.org/abs/2412.20377