Incentivizing Inclusive Contributions in Model Sharing Markets

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Zhang, Enpei, Chai, Jingyi, Ye, Rui, Wang, Yanfeng, Chen, Siheng
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918009230065664
author Zhang, Enpei
Chai, Jingyi
Ye, Rui
Wang, Yanfeng
Chen, Siheng
author_facet Zhang, Enpei
Chai, Jingyi
Ye, Rui
Wang, Yanfeng
Chen, Siheng
contents While data plays a crucial role in training contemporary AI models, it is acknowledged that valuable public data will be exhausted in a few years, directing the world's attention towards the massive decentralized private data. However, the privacy-sensitive nature of raw data and lack of incentive mechanism prevent these valuable data from being fully exploited. Addressing these challenges, this paper proposes inclusive and incentivized personalized federated learning (iPFL), which incentivizes data holders with diverse purposes to collaboratively train personalized models without revealing raw data. iPFL constructs a model-sharing market by solving a graph-based training optimization and incorporates an incentive mechanism based on game theory principles. Theoretical analysis shows that iPFL adheres to two key incentive properties: individual rationality and truthfulness. Empirical studies on eleven AI tasks (e.g., large language models' instruction-following tasks) demonstrate that iPFL consistently achieves the highest economic utility, and better or comparable model performance compared to baseline methods. We anticipate that our iPFL can serve as a valuable technique for boosting future AI models on decentralized private data while making everyone satisfied.
format Preprint
id arxiv_https___arxiv_org_abs_2505_02462
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Incentivizing Inclusive Contributions in Model Sharing Markets
Zhang, Enpei
Chai, Jingyi
Ye, Rui
Wang, Yanfeng
Chen, Siheng
Artificial Intelligence
Computation and Language
Computer Science and Game Theory
While data plays a crucial role in training contemporary AI models, it is acknowledged that valuable public data will be exhausted in a few years, directing the world's attention towards the massive decentralized private data. However, the privacy-sensitive nature of raw data and lack of incentive mechanism prevent these valuable data from being fully exploited. Addressing these challenges, this paper proposes inclusive and incentivized personalized federated learning (iPFL), which incentivizes data holders with diverse purposes to collaboratively train personalized models without revealing raw data. iPFL constructs a model-sharing market by solving a graph-based training optimization and incorporates an incentive mechanism based on game theory principles. Theoretical analysis shows that iPFL adheres to two key incentive properties: individual rationality and truthfulness. Empirical studies on eleven AI tasks (e.g., large language models' instruction-following tasks) demonstrate that iPFL consistently achieves the highest economic utility, and better or comparable model performance compared to baseline methods. We anticipate that our iPFL can serve as a valuable technique for boosting future AI models on decentralized private data while making everyone satisfied.
title Incentivizing Inclusive Contributions in Model Sharing Markets
topic Artificial Intelligence
Computation and Language
Computer Science and Game Theory
url https://arxiv.org/abs/2505.02462