Representation-Aligned Multi-Scale Personalization for Federated Learning

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Liang, Wenfei, Tay, Wee Peng
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913025909325824
author Liang, Wenfei
Tay, Wee Peng
author_facet Liang, Wenfei
Tay, Wee Peng
contents In federated learning (FL), accommodating clients with diverse resource constraints remains a significant challenge. A widely adopted approach is to use a shared full-size model, from which each client extracts a submodel aligned with its computational budget. However, regardless of the specific scoring strategy, these methods rely on the same global backbone, limiting both structural diversity and representational adaptation across clients. This paper presents FRAMP, a unified framework for personalized and resource-adaptive federated learning. Instead of relying on a fixed global model, FRAMP generates client-specific models from compact client descriptors, enabling fine-grained adaptation to both data characteristics and computational budgets. Each client trains a tailored lightweight submodel and aligns its learned representation with others to maintain global semantic consistency. Extensive experiments on vision and graph benchmarks demonstrate that FRAMP enhances generalization and adaptivity across a wide range of client settings.
format Preprint
id arxiv_https___arxiv_org_abs_2604_11278
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Representation-Aligned Multi-Scale Personalization for Federated Learning
Liang, Wenfei
Tay, Wee Peng
Machine Learning
In federated learning (FL), accommodating clients with diverse resource constraints remains a significant challenge. A widely adopted approach is to use a shared full-size model, from which each client extracts a submodel aligned with its computational budget. However, regardless of the specific scoring strategy, these methods rely on the same global backbone, limiting both structural diversity and representational adaptation across clients. This paper presents FRAMP, a unified framework for personalized and resource-adaptive federated learning. Instead of relying on a fixed global model, FRAMP generates client-specific models from compact client descriptors, enabling fine-grained adaptation to both data characteristics and computational budgets. Each client trains a tailored lightweight submodel and aligns its learned representation with others to maintain global semantic consistency. Extensive experiments on vision and graph benchmarks demonstrate that FRAMP enhances generalization and adaptivity across a wide range of client settings.
title Representation-Aligned Multi-Scale Personalization for Federated Learning
topic Machine Learning
url https://arxiv.org/abs/2604.11278