Research on Large Language Model Cross-Cloud Privacy Protection and Collaborative Training based on Federated Learning
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866912277020540928 |
|---|---|
| author | Yang, Ze Jin, Yihong Zhang, Yihan Liu, Juntian Xu, Xinhe |
| author_facet | Yang, Ze Jin, Yihong Zhang, Yihan Liu, Juntian Xu, Xinhe |
| contents | The fast development of large language models (LLMs) and popularization of cloud computing have led to increasing concerns on privacy safeguarding and data security of cross-cloud model deployment and training as the key challenges. We present a new framework for addressing these issues along with enabling privacy preserving collaboration on training between distributed clouds based on federated learning. Our mechanism encompasses cutting-edge cryptographic primitives, dynamic model aggregation techniques, and cross-cloud data harmonization solutions to enhance security, efficiency, and scalability to the traditional federated learning paradigm. Furthermore, we proposed a hybrid aggregation scheme to mitigate the threat of Data Leakage and to optimize the aggregation of model updates, thus achieving substantial enhancement on the model effectiveness and stability. Experimental results demonstrate that the training efficiency, privacy protection, and model accuracy of the proposed model compare favorably to those of the traditional federated learning method. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_12226 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Research on Large Language Model Cross-Cloud Privacy Protection and Collaborative Training based on Federated Learning Yang, Ze Jin, Yihong Zhang, Yihan Liu, Juntian Xu, Xinhe Cryptography and Security Artificial Intelligence The fast development of large language models (LLMs) and popularization of cloud computing have led to increasing concerns on privacy safeguarding and data security of cross-cloud model deployment and training as the key challenges. We present a new framework for addressing these issues along with enabling privacy preserving collaboration on training between distributed clouds based on federated learning. Our mechanism encompasses cutting-edge cryptographic primitives, dynamic model aggregation techniques, and cross-cloud data harmonization solutions to enhance security, efficiency, and scalability to the traditional federated learning paradigm. Furthermore, we proposed a hybrid aggregation scheme to mitigate the threat of Data Leakage and to optimize the aggregation of model updates, thus achieving substantial enhancement on the model effectiveness and stability. Experimental results demonstrate that the training efficiency, privacy protection, and model accuracy of the proposed model compare favorably to those of the traditional federated learning method. |
| title | Research on Large Language Model Cross-Cloud Privacy Protection and Collaborative Training based on Federated Learning |
| topic | Cryptography and Security Artificial Intelligence |
| url | https://arxiv.org/abs/2503.12226 |