How Can Incentives and Cut Layer Selection Influence Data Contribution in Split Federated Learning?

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lee, Joohyung, Cho, Jungchan, Lee, Wonjun, Seif, Mohamed, Poor, H. Vincent
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916578935701504
author Lee, Joohyung
Cho, Jungchan
Lee, Wonjun
Seif, Mohamed
Poor, H. Vincent
author_facet Lee, Joohyung
Cho, Jungchan
Lee, Wonjun
Seif, Mohamed
Poor, H. Vincent
contents To alleviate the training burden in federated learning while enhancing convergence speed, Split Federated Learning (SFL) has emerged as a promising approach by combining the advantages of federated and split learning. However, recent studies have largely overlooked competitive situations. In this framework, the SFL model owner can choose the cut layer to balance the training load between the server and clients, ensuring the necessary level of privacy for the clients. Additionally, the SFL model owner sets incentives to encourage client participation in the SFL process. The optimization strategies employed by the SFL model owner influence clients' decisions regarding the amount of data they contribute, taking into account the shared incentives over clients and anticipated energy consumption during SFL. To address this framework, we model the problem using a hierarchical decision-making approach, formulated as a single-leader multi-follower Stackelberg game. We demonstrate the existence and uniqueness of the Nash equilibrium among clients and analyze the Stackelberg equilibrium by examining the leader's game. Furthermore, we discuss privacy concerns related to differential privacy and the criteria for selecting the minimum required cut layer. Our findings show that the Stackelberg equilibrium solution maximizes the utility for both the clients and the SFL model owner.
format Preprint
id arxiv_https___arxiv_org_abs_2412_07813
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle How Can Incentives and Cut Layer Selection Influence Data Contribution in Split Federated Learning?
Lee, Joohyung
Cho, Jungchan
Lee, Wonjun
Seif, Mohamed
Poor, H. Vincent
Computer Science and Game Theory
Artificial Intelligence
Machine Learning
To alleviate the training burden in federated learning while enhancing convergence speed, Split Federated Learning (SFL) has emerged as a promising approach by combining the advantages of federated and split learning. However, recent studies have largely overlooked competitive situations. In this framework, the SFL model owner can choose the cut layer to balance the training load between the server and clients, ensuring the necessary level of privacy for the clients. Additionally, the SFL model owner sets incentives to encourage client participation in the SFL process. The optimization strategies employed by the SFL model owner influence clients' decisions regarding the amount of data they contribute, taking into account the shared incentives over clients and anticipated energy consumption during SFL. To address this framework, we model the problem using a hierarchical decision-making approach, formulated as a single-leader multi-follower Stackelberg game. We demonstrate the existence and uniqueness of the Nash equilibrium among clients and analyze the Stackelberg equilibrium by examining the leader's game. Furthermore, we discuss privacy concerns related to differential privacy and the criteria for selecting the minimum required cut layer. Our findings show that the Stackelberg equilibrium solution maximizes the utility for both the clients and the SFL model owner.
title How Can Incentives and Cut Layer Selection Influence Data Contribution in Split Federated Learning?
topic Computer Science and Game Theory
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2412.07813