Saved in:
Bibliographic Details
Main Authors: Li, Hongze, Zhou, Zesheng, Cao, Zhenbiao, Li, Xinhui, Chen, Wei, Zhang, Xiaojin
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2505.02515
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908844881346560
author Li, Hongze
Zhou, Zesheng
Cao, Zhenbiao
Li, Xinhui
Chen, Wei
Zhang, Xiaojin
author_facet Li, Hongze
Zhou, Zesheng
Cao, Zhenbiao
Li, Xinhui
Chen, Wei
Zhang, Xiaojin
contents Traditional Federated Domain Generalization (FedDG) methods focus on learning domain-invariant features or adapting to unseen target domains, often overlooking the unique knowledge embedded within the source domain, especially in strictly isolated federated learning environments. Through experimentation, we discovered a counterintuitive phenomenon: features learned from a complete source domain have superior generalization capabilities compared to those learned directly from the target domain. This insight leads us to propose the Federated Source Domain Awareness Framework (FedSDAF), the first systematic approach to enhance FedDG by leveraging source domain-aware features. FedSDAF employs a dual-adapter architecture that decouples "local expertise" from "global generalization consensus." A Domain-Aware Adapter, retained locally, extracts and protects the unique discriminative knowledge of each source domain, while a Domain-Invariant Adapter, shared across clients, builds a robust global consensus. To enable knowledge exchange, we introduce a Bidirectional Knowledge Distillation mechanism that facilitates efficient dialogue between the adapters. Extensive experiments on four benchmark datasets (OfficeHome, PACS, VLCS, and DomainNet) show that FedSDAF significantly outperforms existing FedDG methods. The source code is available at https://github.com/pizzareapers/FedSDAF.
format Preprint
id arxiv_https___arxiv_org_abs_2505_02515
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle FedSDAF: Leveraging Source Domain Awareness for Enhanced Federated Domain Generalization
Li, Hongze
Zhou, Zesheng
Cao, Zhenbiao
Li, Xinhui
Chen, Wei
Zhang, Xiaojin
Machine Learning
Traditional Federated Domain Generalization (FedDG) methods focus on learning domain-invariant features or adapting to unseen target domains, often overlooking the unique knowledge embedded within the source domain, especially in strictly isolated federated learning environments. Through experimentation, we discovered a counterintuitive phenomenon: features learned from a complete source domain have superior generalization capabilities compared to those learned directly from the target domain. This insight leads us to propose the Federated Source Domain Awareness Framework (FedSDAF), the first systematic approach to enhance FedDG by leveraging source domain-aware features. FedSDAF employs a dual-adapter architecture that decouples "local expertise" from "global generalization consensus." A Domain-Aware Adapter, retained locally, extracts and protects the unique discriminative knowledge of each source domain, while a Domain-Invariant Adapter, shared across clients, builds a robust global consensus. To enable knowledge exchange, we introduce a Bidirectional Knowledge Distillation mechanism that facilitates efficient dialogue between the adapters. Extensive experiments on four benchmark datasets (OfficeHome, PACS, VLCS, and DomainNet) show that FedSDAF significantly outperforms existing FedDG methods. The source code is available at https://github.com/pizzareapers/FedSDAF.
title FedSDAF: Leveraging Source Domain Awareness for Enhanced Federated Domain Generalization
topic Machine Learning
url https://arxiv.org/abs/2505.02515