Towards Efficient Communication and Secure Federated Recommendation System via Low-rank Training
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910346113974272 |
|---|---|
| author | Nguyen, Ngoc-Hieu Nguyen, Tuan-Anh Nguyen, Tuan Hoang, Vu Tien Le, Dung D. Wong, Kok-Seng |
| author_facet | Nguyen, Ngoc-Hieu Nguyen, Tuan-Anh Nguyen, Tuan Hoang, Vu Tien Le, Dung D. Wong, Kok-Seng |
| contents | Federated Recommendation (FedRec) systems have emerged as a solution to safeguard users' data in response to growing regulatory concerns. However, one of the major challenges in these systems lies in the communication costs that arise from the need to transmit neural network models between user devices and a central server. Prior approaches to these challenges often lead to issues such as computational overheads, model specificity constraints, and compatibility issues with secure aggregation protocols. In response, we propose a novel framework, called Correlated Low-rank Structure (CoLR), which leverages the concept of adjusting lightweight trainable parameters while keeping most parameters frozen. Our approach substantially reduces communication overheads without introducing additional computational burdens. Critically, our framework remains fully compatible with secure aggregation protocols, including the robust use of Homomorphic Encryption. The approach resulted in a reduction of up to 93.75% in payload size, with only an approximate 8% decrease in recommendation performance across datasets. Code for reproducing our experiments can be found at https://github.com/NNHieu/CoLR-FedRec. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_03748 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Towards Efficient Communication and Secure Federated Recommendation System via Low-rank Training Nguyen, Ngoc-Hieu Nguyen, Tuan-Anh Nguyen, Tuan Hoang, Vu Tien Le, Dung D. Wong, Kok-Seng Machine Learning Cryptography and Security Distributed, Parallel, and Cluster Computing Information Retrieval Federated Recommendation (FedRec) systems have emerged as a solution to safeguard users' data in response to growing regulatory concerns. However, one of the major challenges in these systems lies in the communication costs that arise from the need to transmit neural network models between user devices and a central server. Prior approaches to these challenges often lead to issues such as computational overheads, model specificity constraints, and compatibility issues with secure aggregation protocols. In response, we propose a novel framework, called Correlated Low-rank Structure (CoLR), which leverages the concept of adjusting lightweight trainable parameters while keeping most parameters frozen. Our approach substantially reduces communication overheads without introducing additional computational burdens. Critically, our framework remains fully compatible with secure aggregation protocols, including the robust use of Homomorphic Encryption. The approach resulted in a reduction of up to 93.75% in payload size, with only an approximate 8% decrease in recommendation performance across datasets. Code for reproducing our experiments can be found at https://github.com/NNHieu/CoLR-FedRec. |
| title | Towards Efficient Communication and Secure Federated Recommendation System via Low-rank Training |
| topic | Machine Learning Cryptography and Security Distributed, Parallel, and Cluster Computing Information Retrieval |
| url | https://arxiv.org/abs/2401.03748 |