Towards Fairness under Label Bias in Image Segmentation: Impact, Measurement and Mitigation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Parikh, Aditya, Frank, Stella, Das, Sneha, Feragen, Aasa
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914542368325632
author Parikh, Aditya
Frank, Stella
Das, Sneha
Feragen, Aasa
author_facet Parikh, Aditya
Frank, Stella
Das, Sneha
Feragen, Aasa
contents Labeled datasets reflect the biases of their annotation pipelines, which sometimes introduce label bias: group-conditional label errors that cause systematic performance disparities across demographic subgroups. Label bias in image segmentation remains underexplored, as even detecting it typically requires clean, unbiased annotations, which are not readily available. We present a data-centric adaptation of Confident Learning to segmentation, allowing detection of label bias directly in the training data without a clean, unbiased ground truth. By comparing the provided training labels to the model's confident predictions, we isolate directional errors that quantify the presence and nature of bias, where standard overlap metrics like Dice fail. We further show that label bias influences subgroup separability in the encoder's feature space, an artifact we leverage for bias mitigation rather than suppressing it. We evaluate three datasets, spanning from synthetic to real-life bias, showing how our framework reliably detects and mitigates bias without access to clean labels, achieving equitable performance across experimental conditions.
format Preprint
id arxiv_https___arxiv_org_abs_2605_06891
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Towards Fairness under Label Bias in Image Segmentation: Impact, Measurement and Mitigation
Parikh, Aditya
Frank, Stella
Das, Sneha
Feragen, Aasa
Computer Vision and Pattern Recognition
Machine Learning
Labeled datasets reflect the biases of their annotation pipelines, which sometimes introduce label bias: group-conditional label errors that cause systematic performance disparities across demographic subgroups. Label bias in image segmentation remains underexplored, as even detecting it typically requires clean, unbiased annotations, which are not readily available. We present a data-centric adaptation of Confident Learning to segmentation, allowing detection of label bias directly in the training data without a clean, unbiased ground truth. By comparing the provided training labels to the model's confident predictions, we isolate directional errors that quantify the presence and nature of bias, where standard overlap metrics like Dice fail. We further show that label bias influences subgroup separability in the encoder's feature space, an artifact we leverage for bias mitigation rather than suppressing it. We evaluate three datasets, spanning from synthetic to real-life bias, showing how our framework reliably detects and mitigates bias without access to clean labels, achieving equitable performance across experimental conditions.
title Towards Fairness under Label Bias in Image Segmentation: Impact, Measurement and Mitigation
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2605.06891