Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2501.12046 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915687186825216 |
|---|---|
| author | Ling, Chih Wei Shiu, Chun Hei Michael Wu, Youqi Sun, Jiande Li, Cheuk Ting Song, Linqi Xu, Weitao |
| author_facet | Ling, Chih Wei Shiu, Chun Hei Michael Wu, Youqi Sun, Jiande Li, Cheuk Ting Song, Linqi Xu, Weitao |
| contents | Training machine learning models on decentralized private data via federated learning (FL) poses two key challenges: communication efficiency and privacy protection. In this work, we address these challenges within the trusted aggregator model by introducing a novel approach called the Communication-Efficient and Privacy-Adaptable Mechanism (CEPAM), achieving both objectives simultaneously. In particular, CEPAM leverages the rejection-sampled universal quantizer (RSUQ), a construction of randomized vector quantizer whose resulting distortion is equivalent to a prescribed noise, such as Gaussian or Laplace noise, enabling joint differential privacy and compression. Our CEPAM provides the additional benefit of privacy adaptability, allowing clients and the server to customize privacy protection based on required accuracy and protection. We theoretically analyze the privacy guarantee of CEPAM and investigate the trade-offs among user privacy and accuracy of CEPAM through experimental evaluations. Moreover, we assess CEPAM's utility performance using MNIST dataset, demonstrating that CEPAM surpasses baseline models in terms of learning accuracy. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_12046 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Communication-Efficient and Privacy-Adaptable Mechanism for Federated Learning Ling, Chih Wei Shiu, Chun Hei Michael Wu, Youqi Sun, Jiande Li, Cheuk Ting Song, Linqi Xu, Weitao Machine Learning Training machine learning models on decentralized private data via federated learning (FL) poses two key challenges: communication efficiency and privacy protection. In this work, we address these challenges within the trusted aggregator model by introducing a novel approach called the Communication-Efficient and Privacy-Adaptable Mechanism (CEPAM), achieving both objectives simultaneously. In particular, CEPAM leverages the rejection-sampled universal quantizer (RSUQ), a construction of randomized vector quantizer whose resulting distortion is equivalent to a prescribed noise, such as Gaussian or Laplace noise, enabling joint differential privacy and compression. Our CEPAM provides the additional benefit of privacy adaptability, allowing clients and the server to customize privacy protection based on required accuracy and protection. We theoretically analyze the privacy guarantee of CEPAM and investigate the trade-offs among user privacy and accuracy of CEPAM through experimental evaluations. Moreover, we assess CEPAM's utility performance using MNIST dataset, demonstrating that CEPAM surpasses baseline models in terms of learning accuracy. |
| title | Communication-Efficient and Privacy-Adaptable Mechanism for Federated Learning |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2501.12046 |