On Performance Guarantees for Federated Learning with Personalized Constraints

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Ebrahimi, Mohammadjavad, Burbano, Daniel, Yousefian, Farzad
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917354212950016
author Ebrahimi, Mohammadjavad
Burbano, Daniel
Yousefian, Farzad
author_facet Ebrahimi, Mohammadjavad
Burbano, Daniel
Yousefian, Farzad
contents Federated learning (FL) has emerged as a communication-efficient algorithmic framework for distributed learning across multiple agents. While standard FL formulations capture unconstrained or globally constrained problems, many practical settings involve heterogeneous resource or model constraints, leading to optimization problems with agent-specific feasible sets. Here, we study a personalized constrained federated optimization problem in which each agent is associated with a convex local objective and a private constraint set. We propose PC-FedAvg, a method in which each agent maintains cross-estimates of the other agents' variables through a multi-block local decision vector. Each agent updates all blocks locally, penalizing infeasibility only in its own block. Moreover, the cross-estimate mechanism enables personalization without requiring consensus or sharing constraint information among agents. We establish communication-complexity rates of $\mathcal{O}(ε^{-2})$ for suboptimality and $\mathcal{O}(ε^{-1})$ for agent-wise infeasibility. Preliminary experiments on the MNIST and CIFAR-10 datasets validate our theoretical findings.
format Preprint
id arxiv_https___arxiv_org_abs_2603_19617
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle On Performance Guarantees for Federated Learning with Personalized Constraints
Ebrahimi, Mohammadjavad
Burbano, Daniel
Yousefian, Farzad
Machine Learning
Optimization and Control
Federated learning (FL) has emerged as a communication-efficient algorithmic framework for distributed learning across multiple agents. While standard FL formulations capture unconstrained or globally constrained problems, many practical settings involve heterogeneous resource or model constraints, leading to optimization problems with agent-specific feasible sets. Here, we study a personalized constrained federated optimization problem in which each agent is associated with a convex local objective and a private constraint set. We propose PC-FedAvg, a method in which each agent maintains cross-estimates of the other agents' variables through a multi-block local decision vector. Each agent updates all blocks locally, penalizing infeasibility only in its own block. Moreover, the cross-estimate mechanism enables personalization without requiring consensus or sharing constraint information among agents. We establish communication-complexity rates of $\mathcal{O}(ε^{-2})$ for suboptimality and $\mathcal{O}(ε^{-1})$ for agent-wise infeasibility. Preliminary experiments on the MNIST and CIFAR-10 datasets validate our theoretical findings.
title On Performance Guarantees for Federated Learning with Personalized Constraints
topic Machine Learning
Optimization and Control
url https://arxiv.org/abs/2603.19617