Diffusing DeBias: Synthetic Bias Amplification for Model Debiasing

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ciranni, Massimiliano, Pastore, Vito Paolo, Di Via, Roberto, Tartaglione, Enzo, Odone, Francesca, Murino, Vittorio
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914112065241088
author Ciranni, Massimiliano
Pastore, Vito Paolo
Di Via, Roberto
Tartaglione, Enzo
Odone, Francesca
Murino, Vittorio
author_facet Ciranni, Massimiliano
Pastore, Vito Paolo
Di Via, Roberto
Tartaglione, Enzo
Odone, Francesca
Murino, Vittorio
contents Deep learning model effectiveness in classification tasks is often challenged by the quality and quantity of training data whenever they are affected by strong spurious correlations between specific attributes and target labels. This results in a form of bias affecting training data, which typically leads to unrecoverable weak generalization in prediction. This paper aims at facing this problem by leveraging bias amplification with generated synthetic data: we introduce Diffusing DeBias (DDB), a novel approach acting as a plug-in for common methods of unsupervised model debiasing exploiting the inherent bias-learning tendency of diffusion models in data generation. Specifically, our approach adopts conditional diffusion models to generate synthetic bias-aligned images, which replace the original training set for learning an effective bias amplifier model that we subsequently incorporate into an end-to-end and a two-step unsupervised debiasing approach. By tackling the fundamental issue of bias-conflicting training samples memorization in learning auxiliary models, typical of this type of techniques, our proposed method beats current state-of-the-art in multiple benchmark datasets, demonstrating its potential as a versatile and effective tool for tackling bias in deep learning models. Code is available at https://github.com/Malga-Vision/DiffusingDeBias
format Preprint
id arxiv_https___arxiv_org_abs_2502_09564
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Diffusing DeBias: Synthetic Bias Amplification for Model Debiasing
Ciranni, Massimiliano
Pastore, Vito Paolo
Di Via, Roberto
Tartaglione, Enzo
Odone, Francesca
Murino, Vittorio
Machine Learning
Computer Vision and Pattern Recognition
I.4; I.5
Deep learning model effectiveness in classification tasks is often challenged by the quality and quantity of training data whenever they are affected by strong spurious correlations between specific attributes and target labels. This results in a form of bias affecting training data, which typically leads to unrecoverable weak generalization in prediction. This paper aims at facing this problem by leveraging bias amplification with generated synthetic data: we introduce Diffusing DeBias (DDB), a novel approach acting as a plug-in for common methods of unsupervised model debiasing exploiting the inherent bias-learning tendency of diffusion models in data generation. Specifically, our approach adopts conditional diffusion models to generate synthetic bias-aligned images, which replace the original training set for learning an effective bias amplifier model that we subsequently incorporate into an end-to-end and a two-step unsupervised debiasing approach. By tackling the fundamental issue of bias-conflicting training samples memorization in learning auxiliary models, typical of this type of techniques, our proposed method beats current state-of-the-art in multiple benchmark datasets, demonstrating its potential as a versatile and effective tool for tackling bias in deep learning models. Code is available at https://github.com/Malga-Vision/DiffusingDeBias
title Diffusing DeBias: Synthetic Bias Amplification for Model Debiasing
topic Machine Learning
Computer Vision and Pattern Recognition
I.4; I.5
url https://arxiv.org/abs/2502.09564