Over-the-Air Federated Learning with Phase Noise: Analysis and Countermeasures
Fuente:
arXiv
Guardado en:
| Autores principales: | , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866917568269254656 |
|---|---|
| author | Dahl, Martin Larsson, Erik G. |
| author_facet | Dahl, Martin Larsson, Erik G. |
| contents | Wirelessly connected devices can collaborately train a machine learning model using federated learning, where the aggregation of model updates occurs using over-the-air computation. Carrier frequency offset caused by imprecise clocks in devices will cause the phase of the over-the-air channel to drift randomly, such that late symbols in a coherence block are transmitted with lower quality than early symbols. To mitigate the effect of degrading symbol quality, we propose a scheme where one of the permutations Roll, Flip and Sort are applied on gradients before transmission. Through simulations we show that the permutations can both improve and degrade learning performance. Furthermore, we derive the expectation and variance of the gradient estimate, which is shown to grow exponentially with the number of symbols in a coherence block. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_08183 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Over-the-Air Federated Learning with Phase Noise: Analysis and Countermeasures Dahl, Martin Larsson, Erik G. Signal Processing Distributed, Parallel, and Cluster Computing Wirelessly connected devices can collaborately train a machine learning model using federated learning, where the aggregation of model updates occurs using over-the-air computation. Carrier frequency offset caused by imprecise clocks in devices will cause the phase of the over-the-air channel to drift randomly, such that late symbols in a coherence block are transmitted with lower quality than early symbols. To mitigate the effect of degrading symbol quality, we propose a scheme where one of the permutations Roll, Flip and Sort are applied on gradients before transmission. Through simulations we show that the permutations can both improve and degrade learning performance. Furthermore, we derive the expectation and variance of the gradient estimate, which is shown to grow exponentially with the number of symbols in a coherence block. |
| title | Over-the-Air Federated Learning with Phase Noise: Analysis and Countermeasures |
| topic | Signal Processing Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2401.08183 |