Dataset Dictionary Learning in a Wasserstein Space for Federated Domain Adaptation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Montesuma, Eduardo Fernandes, Castellon, Fabiola Espinoza, Mboula, Fred Ngolè, Mayoue, Aurélien, Souloumiac, Antoine, Gouy-Pailler, Cédric
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909257401630720
author Montesuma, Eduardo Fernandes
Castellon, Fabiola Espinoza
Mboula, Fred Ngolè
Mayoue, Aurélien
Souloumiac, Antoine
Gouy-Pailler, Cédric
author_facet Montesuma, Eduardo Fernandes
Castellon, Fabiola Espinoza
Mboula, Fred Ngolè
Mayoue, Aurélien
Souloumiac, Antoine
Gouy-Pailler, Cédric
contents Multi-Source Domain Adaptation (MSDA) is a challenging scenario where multiple related and heterogeneous source datasets must be adapted to an unlabeled target dataset. Conventional MSDA methods often overlook that data holders may have privacy concerns, hindering direct data sharing. In response, decentralized MSDA has emerged as a promising strategy to achieve adaptation without centralizing clients' data. Our work proposes a novel approach, Decentralized Dataset Dictionary Learning, to address this challenge. Our method leverages Wasserstein barycenters to model the distributional shift across multiple clients, enabling effective adaptation while preserving data privacy. Specifically, our algorithm expresses each client's underlying distribution as a Wasserstein barycenter of public atoms, weighted by private barycentric coordinates. Our approach ensures that the barycentric coordinates remain undisclosed throughout the adaptation process. Extensive experimentation across five visual domain adaptation benchmarks demonstrates the superiority of our strategy over existing decentralized MSDA techniques. Moreover, our method exhibits enhanced robustness to client parallelism while maintaining relative resilience compared to conventional decentralized MSDA methodologies.
format Preprint
id arxiv_https___arxiv_org_abs_2407_11647
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Dataset Dictionary Learning in a Wasserstein Space for Federated Domain Adaptation
Montesuma, Eduardo Fernandes
Castellon, Fabiola Espinoza
Mboula, Fred Ngolè
Mayoue, Aurélien
Souloumiac, Antoine
Gouy-Pailler, Cédric
Machine Learning
Multi-Source Domain Adaptation (MSDA) is a challenging scenario where multiple related and heterogeneous source datasets must be adapted to an unlabeled target dataset. Conventional MSDA methods often overlook that data holders may have privacy concerns, hindering direct data sharing. In response, decentralized MSDA has emerged as a promising strategy to achieve adaptation without centralizing clients' data. Our work proposes a novel approach, Decentralized Dataset Dictionary Learning, to address this challenge. Our method leverages Wasserstein barycenters to model the distributional shift across multiple clients, enabling effective adaptation while preserving data privacy. Specifically, our algorithm expresses each client's underlying distribution as a Wasserstein barycenter of public atoms, weighted by private barycentric coordinates. Our approach ensures that the barycentric coordinates remain undisclosed throughout the adaptation process. Extensive experimentation across five visual domain adaptation benchmarks demonstrates the superiority of our strategy over existing decentralized MSDA techniques. Moreover, our method exhibits enhanced robustness to client parallelism while maintaining relative resilience compared to conventional decentralized MSDA methodologies.
title Dataset Dictionary Learning in a Wasserstein Space for Federated Domain Adaptation
topic Machine Learning
url https://arxiv.org/abs/2407.11647