Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2602.04352 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912876689620992 |
|---|---|
| author | Biswas, Sayan Frey, Davide Gaudel, Romaric Gupta, Nirupam Kermarrec, Anne-Marie Lerévérend, Dimitri Pires, Rafael Sharma, Rishi Taïani, François de Vos, Martijn |
| author_facet | Biswas, Sayan Frey, Davide Gaudel, Romaric Gupta, Nirupam Kermarrec, Anne-Marie Lerévérend, Dimitri Pires, Rafael Sharma, Rishi Taïani, François de Vos, Martijn |
| contents | Decentralized learning (DL) enables collaborative machine learning (ML) without a central server, making it suitable for settings where training data cannot be centrally hosted. We introduce Mosaic Learning, a DL framework that decomposes models into fragments and disseminates them independently across the network. Fragmentation reduces redundant communication across correlated parameters and enables more diverse information propagation without increasing communication cost. We theoretically show that Mosaic Learning (i) shows state-of-the-art worst-case convergence rate, and (ii) leverages parameter correlation in an ML model, improving contraction by reducing the highest eigenvalue of a simplified system. We empirically evaluate Mosaic Learning on four learning tasks and observe up to 12 percentage points higher node-level test accuracy compared to epidemic learning (EL), a state-of-the-art baseline. In summary, Mosaic Learning improves DL performance without sacrificing its utility or efficiency, and positions itself as a new DL standard. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2602_04352 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Mosaic Learning: A Framework for Decentralized Learning with Model Fragmentation Biswas, Sayan Frey, Davide Gaudel, Romaric Gupta, Nirupam Kermarrec, Anne-Marie Lerévérend, Dimitri Pires, Rafael Sharma, Rishi Taïani, François de Vos, Martijn Machine Learning Decentralized learning (DL) enables collaborative machine learning (ML) without a central server, making it suitable for settings where training data cannot be centrally hosted. We introduce Mosaic Learning, a DL framework that decomposes models into fragments and disseminates them independently across the network. Fragmentation reduces redundant communication across correlated parameters and enables more diverse information propagation without increasing communication cost. We theoretically show that Mosaic Learning (i) shows state-of-the-art worst-case convergence rate, and (ii) leverages parameter correlation in an ML model, improving contraction by reducing the highest eigenvalue of a simplified system. We empirically evaluate Mosaic Learning on four learning tasks and observe up to 12 percentage points higher node-level test accuracy compared to epidemic learning (EL), a state-of-the-art baseline. In summary, Mosaic Learning improves DL performance without sacrificing its utility or efficiency, and positions itself as a new DL standard. |
| title | Mosaic Learning: A Framework for Decentralized Learning with Model Fragmentation |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2602.04352 |