Embedding-Based Federated Data Sharing via Differentially Private Conditional VAEs

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Di Salvo, Francesco, Nguyen, Hanh Huyen My, Ledig, Christian
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918081404600320
author Di Salvo, Francesco
Nguyen, Hanh Huyen My
Ledig, Christian
author_facet Di Salvo, Francesco
Nguyen, Hanh Huyen My
Ledig, Christian
contents Deep Learning (DL) has revolutionized medical imaging, yet its adoption is constrained by data scarcity and privacy regulations, limiting access to diverse datasets. Federated Learning (FL) enables decentralized training but suffers from high communication costs and is often restricted to a single downstream task, reducing flexibility. We propose a data-sharing method via Differentially Private (DP) generative models. By adopting foundation models, we extract compact, informative embeddings, reducing redundancy and lowering computational overhead. Clients collaboratively train a Differentially Private Conditional Variational Autoencoder (DP-CVAE) to model a global, privacy-aware data distribution, supporting diverse downstream tasks. Our approach, validated across multiple feature extractors, enhances privacy, scalability, and efficiency, outperforming traditional FL classifiers while ensuring differential privacy. Additionally, DP-CVAE produces higher-fidelity embeddings than DP-CGAN while requiring $5{\times}$ fewer parameters.
format Preprint
id arxiv_https___arxiv_org_abs_2507_02671
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Embedding-Based Federated Data Sharing via Differentially Private Conditional VAEs
Di Salvo, Francesco
Nguyen, Hanh Huyen My
Ledig, Christian
Machine Learning
Computer Vision and Pattern Recognition
Image and Video Processing
Deep Learning (DL) has revolutionized medical imaging, yet its adoption is constrained by data scarcity and privacy regulations, limiting access to diverse datasets. Federated Learning (FL) enables decentralized training but suffers from high communication costs and is often restricted to a single downstream task, reducing flexibility. We propose a data-sharing method via Differentially Private (DP) generative models. By adopting foundation models, we extract compact, informative embeddings, reducing redundancy and lowering computational overhead. Clients collaboratively train a Differentially Private Conditional Variational Autoencoder (DP-CVAE) to model a global, privacy-aware data distribution, supporting diverse downstream tasks. Our approach, validated across multiple feature extractors, enhances privacy, scalability, and efficiency, outperforming traditional FL classifiers while ensuring differential privacy. Additionally, DP-CVAE produces higher-fidelity embeddings than DP-CGAN while requiring $5{\times}$ fewer parameters.
title Embedding-Based Federated Data Sharing via Differentially Private Conditional VAEs
topic Machine Learning
Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2507.02671