Incentives in Federated Learning with Heterogeneous Agents

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Procaccia, Ariel D., Shao, Han, Shapira, Itai
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908798835228672
author Procaccia, Ariel D.
Shao, Han
Shapira, Itai
author_facet Procaccia, Ariel D.
Shao, Han
Shapira, Itai
contents Federated learning promises significant sample-efficiency gains by pooling data across multiple agents, yet incentive misalignment is an obstacle: each update is costly to the contributor but boosts every participant. We introduce a game-theoretic framework that captures heterogeneous data: an agent's utility depends on who supplies each sample, not just how many. Agents aim to meet a PAC-style accuracy threshold at minimal personal cost. We show that uncoordinated play yields pathologies: pure equilibria may not exist, and the best equilibrium can be arbitrarily more costly than cooperation. To steer collaboration, we analyze the cost-minimizing contribution vector, prove that computing it is NP-hard, and derive a polynomial-time linear program that achieves a logarithmic approximation. Finally, pairing the LP with a simple pay what you contribute rule, where each agent receives a payment equal to its sample cost, yields a mechanism that is strategy-proof and, within the class of contribution-based transfers, is unique.
format Preprint
id arxiv_https___arxiv_org_abs_2509_21612
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Incentives in Federated Learning with Heterogeneous Agents
Procaccia, Ariel D.
Shao, Han
Shapira, Itai
Computer Science and Game Theory
I.2.6
Federated learning promises significant sample-efficiency gains by pooling data across multiple agents, yet incentive misalignment is an obstacle: each update is costly to the contributor but boosts every participant. We introduce a game-theoretic framework that captures heterogeneous data: an agent's utility depends on who supplies each sample, not just how many. Agents aim to meet a PAC-style accuracy threshold at minimal personal cost. We show that uncoordinated play yields pathologies: pure equilibria may not exist, and the best equilibrium can be arbitrarily more costly than cooperation. To steer collaboration, we analyze the cost-minimizing contribution vector, prove that computing it is NP-hard, and derive a polynomial-time linear program that achieves a logarithmic approximation. Finally, pairing the LP with a simple pay what you contribute rule, where each agent receives a payment equal to its sample cost, yields a mechanism that is strategy-proof and, within the class of contribution-based transfers, is unique.
title Incentives in Federated Learning with Heterogeneous Agents
topic Computer Science and Game Theory
I.2.6
url https://arxiv.org/abs/2509.21612