Saved in:
Bibliographic Details
Main Authors: Xu, Zikang, Tang, Fenghe, Quan, Quan, Yao, Qingsong, Zhou, S. Kevin
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2403.05114
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909132280299520
author Xu, Zikang
Tang, Fenghe
Quan, Quan
Yao, Qingsong
Zhou, S. Kevin
author_facet Xu, Zikang
Tang, Fenghe
Quan, Quan
Yao, Qingsong
Zhou, S. Kevin
contents Ensuring fairness in deep-learning-based segmentors is crucial for health equity. Much effort has been dedicated to mitigating unfairness in the training datasets or procedures. However, with the increasing prevalence of foundation models in medical image analysis, it is hard to train fair models from scratch while preserving utility. In this paper, we propose a novel method, Adversarial Privacy-aware Perturbations on Latent Embedding (APPLE), that can improve the fairness of deployed segmentors by introducing a small latent feature perturber without updating the weights of the original model. By adding perturbation to the latent vector, APPLE decorates the latent vector of segmentors such that no fairness-related features can be passed to the decoder of the segmentors while preserving the architecture and parameters of the segmentor. Experiments on two segmentation datasets and five segmentors (three U-Net-like and two SAM-like) illustrate the effectiveness of our proposed method compared to several unfairness mitigation methods.
format Preprint
id arxiv_https___arxiv_org_abs_2403_05114
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle APPLE: Adversarial Privacy-aware Perturbations on Latent Embedding for Unfairness Mitigation
Xu, Zikang
Tang, Fenghe
Quan, Quan
Yao, Qingsong
Zhou, S. Kevin
Computer Vision and Pattern Recognition
Ensuring fairness in deep-learning-based segmentors is crucial for health equity. Much effort has been dedicated to mitigating unfairness in the training datasets or procedures. However, with the increasing prevalence of foundation models in medical image analysis, it is hard to train fair models from scratch while preserving utility. In this paper, we propose a novel method, Adversarial Privacy-aware Perturbations on Latent Embedding (APPLE), that can improve the fairness of deployed segmentors by introducing a small latent feature perturber without updating the weights of the original model. By adding perturbation to the latent vector, APPLE decorates the latent vector of segmentors such that no fairness-related features can be passed to the decoder of the segmentors while preserving the architecture and parameters of the segmentor. Experiments on two segmentation datasets and five segmentors (three U-Net-like and two SAM-like) illustrate the effectiveness of our proposed method compared to several unfairness mitigation methods.
title APPLE: Adversarial Privacy-aware Perturbations on Latent Embedding for Unfairness Mitigation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2403.05114