Saved in:
Bibliographic Details
Main Authors: Belhadj, Samia, Park, Sanguk, Seth, Ambika, Dar, Hesham, Kooi, Thijs
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2409.19940
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916414921637888
author Belhadj, Samia
Park, Sanguk
Seth, Ambika
Dar, Hesham
Kooi, Thijs
author_facet Belhadj, Samia
Park, Sanguk
Seth, Ambika
Dar, Hesham
Kooi, Thijs
contents Fairness in medical AI is increasingly recognized as a crucial aspect of healthcare delivery. While most of the prior work done on fairness emphasizes the importance of equal performance, we argue that decreases in fairness can be either harmful or non-harmful, depending on the type of change and how sensitive attributes are used. To this end, we introduce the notion of positive-sum fairness, which states that an increase in performance that results in a larger group disparity is acceptable as long as it does not come at the cost of individual subgroup performance. This allows sensitive attributes correlated with the disease to be used to increase performance without compromising on fairness. We illustrate this idea by comparing four CNN models that make different use of the race attribute in the training phase. The results show that removing all demographic encodings from the images helps close the gap in performance between the different subgroups, whereas leveraging the race attribute as a model's input increases the overall performance while widening the disparities between subgroups. These larger gaps are then put in perspective of the collective benefit through our notion of positive-sum fairness to distinguish harmful from non harmful disparities.
format Preprint
id arxiv_https___arxiv_org_abs_2409_19940
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Positive-Sum Fairness: Leveraging Demographic Attributes to Achieve Fair AI Outcomes Without Sacrificing Group Gains
Belhadj, Samia
Park, Sanguk
Seth, Ambika
Dar, Hesham
Kooi, Thijs
Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
Computers and Society
Fairness in medical AI is increasingly recognized as a crucial aspect of healthcare delivery. While most of the prior work done on fairness emphasizes the importance of equal performance, we argue that decreases in fairness can be either harmful or non-harmful, depending on the type of change and how sensitive attributes are used. To this end, we introduce the notion of positive-sum fairness, which states that an increase in performance that results in a larger group disparity is acceptable as long as it does not come at the cost of individual subgroup performance. This allows sensitive attributes correlated with the disease to be used to increase performance without compromising on fairness. We illustrate this idea by comparing four CNN models that make different use of the race attribute in the training phase. The results show that removing all demographic encodings from the images helps close the gap in performance between the different subgroups, whereas leveraging the race attribute as a model's input increases the overall performance while widening the disparities between subgroups. These larger gaps are then put in perspective of the collective benefit through our notion of positive-sum fairness to distinguish harmful from non harmful disparities.
title Positive-Sum Fairness: Leveraging Demographic Attributes to Achieve Fair AI Outcomes Without Sacrificing Group Gains
topic Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
Computers and Society
url https://arxiv.org/abs/2409.19940