APFL: Analytic Personalized Federated Learning via Dual-Stream Least Squares
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913991737999360 |
|---|---|
| author | Fan, Kejia Tang, Jianheng Yang, Zhirui Han, Feijiang Li, Jiaxu He, Run Huang, Yajiang Liu, Anfeng Song, Houbing Herbert Liu, Yunhuai Zhuang, Huiping |
| author_facet | Fan, Kejia Tang, Jianheng Yang, Zhirui Han, Feijiang Li, Jiaxu He, Run Huang, Yajiang Liu, Anfeng Song, Houbing Herbert Liu, Yunhuai Zhuang, Huiping |
| contents | Personalized Federated Learning (PFL) has presented a significant challenge to deliver personalized models to individual clients through collaborative training. Existing PFL methods are often vulnerable to non-IID data, which severely hinders collective generalization and then compromises the subsequent personalization efforts. In this paper, to address this non-IID issue in PFL, we propose an Analytic Personalized Federated Learning (APFL) approach via dual-stream least squares. In our APFL, we use a foundation model as a frozen backbone for feature extraction. Subsequent to the feature extractor, we develop dual-stream analytic models to achieve both collective generalization and individual personalization. Specifically, our APFL incorporates a shared primary stream for global generalization across all clients, and a dedicated refinement stream for local personalization of each individual client. The analytical solutions of our APFL enable its ideal property of heterogeneity invariance, theoretically meaning that each personalized model remains identical regardless of how heterogeneous the data are distributed across all other clients. Empirical results across various datasets also validate the superiority of our APFL over state-of-the-art baselines, with advantages of at least 1.10%-15.45% in accuracy. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_10732 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | APFL: Analytic Personalized Federated Learning via Dual-Stream Least Squares Fan, Kejia Tang, Jianheng Yang, Zhirui Han, Feijiang Li, Jiaxu He, Run Huang, Yajiang Liu, Anfeng Song, Houbing Herbert Liu, Yunhuai Zhuang, Huiping Machine Learning Artificial Intelligence Personalized Federated Learning (PFL) has presented a significant challenge to deliver personalized models to individual clients through collaborative training. Existing PFL methods are often vulnerable to non-IID data, which severely hinders collective generalization and then compromises the subsequent personalization efforts. In this paper, to address this non-IID issue in PFL, we propose an Analytic Personalized Federated Learning (APFL) approach via dual-stream least squares. In our APFL, we use a foundation model as a frozen backbone for feature extraction. Subsequent to the feature extractor, we develop dual-stream analytic models to achieve both collective generalization and individual personalization. Specifically, our APFL incorporates a shared primary stream for global generalization across all clients, and a dedicated refinement stream for local personalization of each individual client. The analytical solutions of our APFL enable its ideal property of heterogeneity invariance, theoretically meaning that each personalized model remains identical regardless of how heterogeneous the data are distributed across all other clients. Empirical results across various datasets also validate the superiority of our APFL over state-of-the-art baselines, with advantages of at least 1.10%-15.45% in accuracy. |
| title | APFL: Analytic Personalized Federated Learning via Dual-Stream Least Squares |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2508.10732 |