Personalized Federated Learning with Residual Fisher Information for Medical Image Segmentation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Zhu, Meilu, Li, Yuxing, Wang, Zhiwei, Lam, Edmund Y.
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917345475166208
author Zhu, Meilu
Li, Yuxing
Wang, Zhiwei
Lam, Edmund Y.
author_facet Zhu, Meilu
Li, Yuxing
Wang, Zhiwei
Lam, Edmund Y.
contents Federated learning enables multiple clients (institutions) to collaboratively train machine learning models without sharing their private data. To address the challenge of data heterogeneity across clients, personalized federated learning (pFL) aims to learn customized models for each client. In this work, we propose pFL-ResFIM, a novel pFL framework that achieves client-adaptive personalization at the parameter level. Specifically, we introduce a new metric, Residual Fisher Information Matrix (ResFIM), to quantify the sensitivity of model parameters to domain discrepancies. To estimate ResFIM for each client model under privacy constraints, we employ a spectral transfer strategy that generates simulated data reflecting the domain styles of different clients. Based on the estimated ResFIM, we partition model parameters into domain-sensitive and domain-invariant components. A personalized model for each client is then constructed by aggregating only the domain-invariant parameters on the server. Extensive experiments on public datasets demonstrate that pFL-ResFIM consistently outperforms state-of-the-art methods, validating its effectiveness.
format Preprint
id arxiv_https___arxiv_org_abs_2603_14848
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Personalized Federated Learning with Residual Fisher Information for Medical Image Segmentation
Zhu, Meilu
Li, Yuxing
Wang, Zhiwei
Lam, Edmund Y.
Computer Vision and Pattern Recognition
Federated learning enables multiple clients (institutions) to collaboratively train machine learning models without sharing their private data. To address the challenge of data heterogeneity across clients, personalized federated learning (pFL) aims to learn customized models for each client. In this work, we propose pFL-ResFIM, a novel pFL framework that achieves client-adaptive personalization at the parameter level. Specifically, we introduce a new metric, Residual Fisher Information Matrix (ResFIM), to quantify the sensitivity of model parameters to domain discrepancies. To estimate ResFIM for each client model under privacy constraints, we employ a spectral transfer strategy that generates simulated data reflecting the domain styles of different clients. Based on the estimated ResFIM, we partition model parameters into domain-sensitive and domain-invariant components. A personalized model for each client is then constructed by aggregating only the domain-invariant parameters on the server. Extensive experiments on public datasets demonstrate that pFL-ResFIM consistently outperforms state-of-the-art methods, validating its effectiveness.
title Personalized Federated Learning with Residual Fisher Information for Medical Image Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2603.14848