Controlled Model Debiasing through Minimal and Interpretable Updates

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Di Gennaro, Federico, Laugel, Thibault, Grari, Vincent, Detyniecki, Marcin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908458499964928
author Di Gennaro, Federico
Laugel, Thibault
Grari, Vincent
Detyniecki, Marcin
author_facet Di Gennaro, Federico
Laugel, Thibault
Grari, Vincent
Detyniecki, Marcin
contents Traditional approaches to learning fair machine learning models often require rebuilding models from scratch, typically without considering potentially existing models. In a context where models need to be retrained frequently, this can lead to inconsistent model updates, as well as redundant and costly validation testing. To address this limitation, we introduce the notion of controlled model debiasing, a novel supervised learning task relying on two desiderata: that the differences between the new fair model and the existing one should be (i) minimal and (ii) interpretable. After providing theoretical guarantees to this new problem, we introduce a novel algorithm for algorithmic fairness, COMMOD, that is both model-agnostic and does not require the sensitive attribute at test time. In addition, our algorithm is explicitly designed to enforce minimal and interpretable changes between biased and debiased predictions in a binary classification task, a property that, while highly desirable in high-stakes applications, is rarely prioritized as an explicit objective in fairness literature. Our approach combines a concept-based architecture and adversarial learning and we demonstrate through empirical results that it achieves comparable performance to state-of-the-art debiasing methods while performing minimal and interpretable prediction changes.
format Preprint
id arxiv_https___arxiv_org_abs_2502_21284
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Controlled Model Debiasing through Minimal and Interpretable Updates
Di Gennaro, Federico
Laugel, Thibault
Grari, Vincent
Detyniecki, Marcin
Machine Learning
Traditional approaches to learning fair machine learning models often require rebuilding models from scratch, typically without considering potentially existing models. In a context where models need to be retrained frequently, this can lead to inconsistent model updates, as well as redundant and costly validation testing. To address this limitation, we introduce the notion of controlled model debiasing, a novel supervised learning task relying on two desiderata: that the differences between the new fair model and the existing one should be (i) minimal and (ii) interpretable. After providing theoretical guarantees to this new problem, we introduce a novel algorithm for algorithmic fairness, COMMOD, that is both model-agnostic and does not require the sensitive attribute at test time. In addition, our algorithm is explicitly designed to enforce minimal and interpretable changes between biased and debiased predictions in a binary classification task, a property that, while highly desirable in high-stakes applications, is rarely prioritized as an explicit objective in fairness literature. Our approach combines a concept-based architecture and adversarial learning and we demonstrate through empirical results that it achieves comparable performance to state-of-the-art debiasing methods while performing minimal and interpretable prediction changes.
title Controlled Model Debiasing through Minimal and Interpretable Updates
topic Machine Learning
url https://arxiv.org/abs/2502.21284