Quantized Rank Reduction: A Communications-Efficient Federated Learning Scheme for Network-Critical Applications
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909689980125184 |
|---|---|
| author | Kritsiolis, Dimitrios Kotropoulos, Constantine |
| author_facet | Kritsiolis, Dimitrios Kotropoulos, Constantine |
| contents | Federated learning is a machine learning approach that enables multiple devices (i.e., agents) to train a shared model cooperatively without exchanging raw data. This technique keeps data localized on user devices, ensuring privacy and security, while each agent trains the model on their own data and only shares model updates. The communication overhead is a significant challenge due to the frequent exchange of model updates between the agents and the central server. In this paper, we propose a communication-efficient federated learning scheme that utilizes low-rank approximation of neural network gradients and quantization to significantly reduce the network load of the decentralized learning process with minimal impact on the model's accuracy. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_11183 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Quantized Rank Reduction: A Communications-Efficient Federated Learning Scheme for Network-Critical Applications Kritsiolis, Dimitrios Kotropoulos, Constantine Machine Learning Federated learning is a machine learning approach that enables multiple devices (i.e., agents) to train a shared model cooperatively without exchanging raw data. This technique keeps data localized on user devices, ensuring privacy and security, while each agent trains the model on their own data and only shares model updates. The communication overhead is a significant challenge due to the frequent exchange of model updates between the agents and the central server. In this paper, we propose a communication-efficient federated learning scheme that utilizes low-rank approximation of neural network gradients and quantization to significantly reduce the network load of the decentralized learning process with minimal impact on the model's accuracy. |
| title | Quantized Rank Reduction: A Communications-Efficient Federated Learning Scheme for Network-Critical Applications |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2507.11183 |