Fairness Shields: Safeguarding against Biased Decision Makers

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Cano, Filip, Henzinger, Thomas A., Könighofer, Bettina, Kueffner, Konstantin, Mallik, Kaushik
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917870207762432
author Cano, Filip
Henzinger, Thomas A.
Könighofer, Bettina
Kueffner, Konstantin
Mallik, Kaushik
author_facet Cano, Filip
Henzinger, Thomas A.
Könighofer, Bettina
Kueffner, Konstantin
Mallik, Kaushik
contents As AI-based decision-makers increasingly influence human lives, it is a growing concern that their decisions are often unfair or biased with respect to people's sensitive attributes, such as gender and race. Most existing bias prevention measures provide probabilistic fairness guarantees in the long run, and it is possible that the decisions are biased on specific instances of short decision sequences. We introduce fairness shielding, where a symbolic decision-maker -- the fairness shield -- continuously monitors the sequence of decisions of another deployed black-box decision-maker, and makes interventions so that a given fairness criterion is met while the total intervention costs are minimized. We present four different algorithms for computing fairness shields, among which one guarantees fairness over fixed horizons, and three guarantee fairness periodically after fixed intervals. Given a distribution over future decisions and their intervention costs, our algorithms solve different instances of bounded-horizon optimal control problems with different levels of computational costs and optimality guarantees. Our empirical evaluation demonstrates the effectiveness of these shields in ensuring fairness while maintaining cost efficiency across various scenarios.
format Preprint
id arxiv_https___arxiv_org_abs_2412_11994
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Fairness Shields: Safeguarding against Biased Decision Makers
Cano, Filip
Henzinger, Thomas A.
Könighofer, Bettina
Kueffner, Konstantin
Mallik, Kaushik
Artificial Intelligence
As AI-based decision-makers increasingly influence human lives, it is a growing concern that their decisions are often unfair or biased with respect to people's sensitive attributes, such as gender and race. Most existing bias prevention measures provide probabilistic fairness guarantees in the long run, and it is possible that the decisions are biased on specific instances of short decision sequences. We introduce fairness shielding, where a symbolic decision-maker -- the fairness shield -- continuously monitors the sequence of decisions of another deployed black-box decision-maker, and makes interventions so that a given fairness criterion is met while the total intervention costs are minimized. We present four different algorithms for computing fairness shields, among which one guarantees fairness over fixed horizons, and three guarantee fairness periodically after fixed intervals. Given a distribution over future decisions and their intervention costs, our algorithms solve different instances of bounded-horizon optimal control problems with different levels of computational costs and optimality guarantees. Our empirical evaluation demonstrates the effectiveness of these shields in ensuring fairness while maintaining cost efficiency across various scenarios.
title Fairness Shields: Safeguarding against Biased Decision Makers
topic Artificial Intelligence
url https://arxiv.org/abs/2412.11994