APPLE: Adversarial Privacy-aware Perturbations on Latent Embedding for Unfairness Mitigation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Xu, Zikang, Tang, Fenghe, Quan, Quan, Yao, Qingsong, Zhou, S. Kevin
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909132280299520
author Xu, Zikang
Tang, Fenghe
Quan, Quan
Yao, Qingsong
Zhou, S. Kevin
author_facet Xu, Zikang
Tang, Fenghe
Quan, Quan
Yao, Qingsong
Zhou, S. Kevin
contents Ensuring fairness in deep-learning-based segmentors is crucial for health equity. Much effort has been dedicated to mitigating unfairness in the training datasets or procedures. However, with the increasing prevalence of foundation models in medical image analysis, it is hard to train fair models from scratch while preserving utility. In this paper, we propose a novel method, Adversarial Privacy-aware Perturbations on Latent Embedding (APPLE), that can improve the fairness of deployed segmentors by introducing a small latent feature perturber without updating the weights of the original model. By adding perturbation to the latent vector, APPLE decorates the latent vector of segmentors such that no fairness-related features can be passed to the decoder of the segmentors while preserving the architecture and parameters of the segmentor. Experiments on two segmentation datasets and five segmentors (three U-Net-like and two SAM-like) illustrate the effectiveness of our proposed method compared to several unfairness mitigation methods.
format Preprint
id arxiv_https___arxiv_org_abs_2403_05114
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle APPLE: Adversarial Privacy-aware Perturbations on Latent Embedding for Unfairness Mitigation
Xu, Zikang
Tang, Fenghe
Quan, Quan
Yao, Qingsong
Zhou, S. Kevin
Computer Vision and Pattern Recognition
Ensuring fairness in deep-learning-based segmentors is crucial for health equity. Much effort has been dedicated to mitigating unfairness in the training datasets or procedures. However, with the increasing prevalence of foundation models in medical image analysis, it is hard to train fair models from scratch while preserving utility. In this paper, we propose a novel method, Adversarial Privacy-aware Perturbations on Latent Embedding (APPLE), that can improve the fairness of deployed segmentors by introducing a small latent feature perturber without updating the weights of the original model. By adding perturbation to the latent vector, APPLE decorates the latent vector of segmentors such that no fairness-related features can be passed to the decoder of the segmentors while preserving the architecture and parameters of the segmentor. Experiments on two segmentation datasets and five segmentors (three U-Net-like and two SAM-like) illustrate the effectiveness of our proposed method compared to several unfairness mitigation methods.
title APPLE: Adversarial Privacy-aware Perturbations on Latent Embedding for Unfairness Mitigation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.05114