Scalable Federated Unlearning via Isolated and Coded Sharding

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Lin, Yijing, Gao, Zhipeng, Du, Hongyang, Niyato, Dusit, Gui, Gui, Cui, Shuguang, Ren, Jinke
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929226602512384
author Lin, Yijing
Gao, Zhipeng
Du, Hongyang
Niyato, Dusit
Gui, Gui
Cui, Shuguang
Ren, Jinke
author_facet Lin, Yijing
Gao, Zhipeng
Du, Hongyang
Niyato, Dusit
Gui, Gui
Cui, Shuguang
Ren, Jinke
contents Federated unlearning has emerged as a promising paradigm to erase the client-level data effect without affecting the performance of collaborative learning models. However, the federated unlearning process often introduces extensive storage overhead and consumes substantial computational resources, thus hindering its implementation in practice. To address this issue, this paper proposes a scalable federated unlearning framework based on isolated sharding and coded computing. We first divide distributed clients into multiple isolated shards across stages to reduce the number of clients being affected. Then, to reduce the storage overhead of the central server, we develop a coded computing mechanism by compressing the model parameters across different shards. In addition, we provide the theoretical analysis of time efficiency and storage effectiveness for the isolated and coded sharding. Finally, extensive experiments on two typical learning tasks, i.e., classification and generation, demonstrate that our proposed framework can achieve better performance than three state-of-the-art frameworks in terms of accuracy, retraining time, storage overhead, and F1 scores for resisting membership inference attacks.
format Preprint
id arxiv_https___arxiv_org_abs_2401_15957
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Scalable Federated Unlearning via Isolated and Coded Sharding
Lin, Yijing
Gao, Zhipeng
Du, Hongyang
Niyato, Dusit
Gui, Gui
Cui, Shuguang
Ren, Jinke
Machine Learning
Artificial Intelligence
Cryptography and Security
Federated unlearning has emerged as a promising paradigm to erase the client-level data effect without affecting the performance of collaborative learning models. However, the federated unlearning process often introduces extensive storage overhead and consumes substantial computational resources, thus hindering its implementation in practice. To address this issue, this paper proposes a scalable federated unlearning framework based on isolated sharding and coded computing. We first divide distributed clients into multiple isolated shards across stages to reduce the number of clients being affected. Then, to reduce the storage overhead of the central server, we develop a coded computing mechanism by compressing the model parameters across different shards. In addition, we provide the theoretical analysis of time efficiency and storage effectiveness for the isolated and coded sharding. Finally, extensive experiments on two typical learning tasks, i.e., classification and generation, demonstrate that our proposed framework can achieve better performance than three state-of-the-art frameworks in terms of accuracy, retraining time, storage overhead, and F1 scores for resisting membership inference attacks.
title Scalable Federated Unlearning via Isolated and Coded Sharding
topic Machine Learning
Artificial Intelligence
Cryptography and Security
url https://arxiv.org/abs/2401.15957