Guardado en:
Detalles Bibliográficos
Autores principales: Tupper, Adam, Gagné, Christian
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:https://arxiv.org/abs/2510.12741
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911210046226432
author Tupper, Adam
Gagné, Christian
author_facet Tupper, Adam
Gagné, Christian
contents Foundation models open up new possibilities for the use of AI in healthcare. However, even when pre-trained on health data, they still need to be fine-tuned for specific downstream tasks. Furthermore, although foundation models reduce the amount of training data required to achieve good performance, obtaining sufficient data is still a challenge. This is due, in part, to restrictions on sharing and aggregating data from different sources to protect patients' privacy. One possible solution to this is to fine-tune foundation models via federated learning across multiple participating clients (i.e., hospitals, clinics, etc.). In this work, we propose a new personalized federated fine-tuning method that learns orthogonal LoRA adapters to disentangle general and client-specific knowledge, enabling each client to fully exploit both their own data and the data of others. Our preliminary results on real-world federated medical imaging tasks demonstrate that our approach is competitive against current federated fine-tuning methods.
format Preprint
id arxiv_https___arxiv_org_abs_2510_12741
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Personalized Federated Fine-Tuning of Vision Foundation Models for Healthcare
Tupper, Adam
Gagné, Christian
Computer Vision and Pattern Recognition
Distributed, Parallel, and Cluster Computing
Foundation models open up new possibilities for the use of AI in healthcare. However, even when pre-trained on health data, they still need to be fine-tuned for specific downstream tasks. Furthermore, although foundation models reduce the amount of training data required to achieve good performance, obtaining sufficient data is still a challenge. This is due, in part, to restrictions on sharing and aggregating data from different sources to protect patients' privacy. One possible solution to this is to fine-tune foundation models via federated learning across multiple participating clients (i.e., hospitals, clinics, etc.). In this work, we propose a new personalized federated fine-tuning method that learns orthogonal LoRA adapters to disentangle general and client-specific knowledge, enabling each client to fully exploit both their own data and the data of others. Our preliminary results on real-world federated medical imaging tasks demonstrate that our approach is competitive against current federated fine-tuning methods.
title Personalized Federated Fine-Tuning of Vision Foundation Models for Healthcare
topic Computer Vision and Pattern Recognition
Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2510.12741