Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.15045 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866911077883707392 |
|---|---|
| author | Shao, Jiaqi Lin, Tao Zhang, Xiaojin Yang, Qiang Luo, Bing |
| author_facet | Shao, Jiaqi Lin, Tao Zhang, Xiaojin Yang, Qiang Luo, Bing |
| contents | Federated Unlearning (FU) enables the removal of specific clients' data influence from trained models. However, in non-IID settings, removing clients creates critical side effects: remaining clients with similar data distributions suffer disproportionate performance degradation, while the global model's stability deteriorates. These vulnerable clients then have reduced incentives to stay in the federation, potentially triggering a cascade of withdrawals that further destabilize the system. To address this challenge, we develop a theoretical framework that quantifies how data heterogeneity impacts unlearning outcomes. Based on these insights, we model FU as a Stackelberg game where the server strategically offers payments to retain crucial clients based on their contribution to both unlearning effectiveness and system stability. Our rigorous equilibrium analysis reveals how data heterogeneity fundamentally shapes the trade-offs between system-wide objectives and client interests. Our approach improves global stability by up to 6.23\%, reduces worst-case client degradation by 10.05\%, and achieves up to 38.6\% runtime efficiency over complete retraining. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_15045 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Beyond Right to be Forgotten: Managing Heterogeneity Side Effects Through Strategic Incentives Shao, Jiaqi Lin, Tao Zhang, Xiaojin Yang, Qiang Luo, Bing Computer Science and Game Theory Artificial Intelligence Federated Unlearning (FU) enables the removal of specific clients' data influence from trained models. However, in non-IID settings, removing clients creates critical side effects: remaining clients with similar data distributions suffer disproportionate performance degradation, while the global model's stability deteriorates. These vulnerable clients then have reduced incentives to stay in the federation, potentially triggering a cascade of withdrawals that further destabilize the system. To address this challenge, we develop a theoretical framework that quantifies how data heterogeneity impacts unlearning outcomes. Based on these insights, we model FU as a Stackelberg game where the server strategically offers payments to retain crucial clients based on their contribution to both unlearning effectiveness and system stability. Our rigorous equilibrium analysis reveals how data heterogeneity fundamentally shapes the trade-offs between system-wide objectives and client interests. Our approach improves global stability by up to 6.23\%, reduces worst-case client degradation by 10.05\%, and achieves up to 38.6\% runtime efficiency over complete retraining. |
| title | Beyond Right to be Forgotten: Managing Heterogeneity Side Effects Through Strategic Incentives |
| topic | Computer Science and Game Theory Artificial Intelligence |
| url | https://arxiv.org/abs/2410.15045 |