Communication-Efficient and Robust Multi-Modal Federated Learning via Latent-Space Consensus
Fuente:
arXiv
Guardado en:
| Autores principales: | , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2026
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866910060205047808 |
|---|---|
| author | Badi, Mohamed Issaid, Chaouki Ben Bennis, Mehdi |
| author_facet | Badi, Mohamed Issaid, Chaouki Ben Bennis, Mehdi |
| contents | Federated learning (FL) enables collaborative model training across distributed devices without sharing raw data, but applying FL to multi-modal settings introduces significant challenges. Clients typically possess heterogeneous modalities and model architectures, making it difficult to align feature spaces efficiently while preserving privacy and minimizing communication costs. To address this, we introduce CoMFed, a Communication-Efficient Multi-Modal Federated Learning framework that uses learnable projection matrices to generate compressed latent representations. A latent-space regularizer aligns these representations across clients, improving cross-modal consistency and robustness to outliers. Experiments on human activity recognition benchmarks show that CoMFed achieves competitive accuracy with minimal overhead. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_19067 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Communication-Efficient and Robust Multi-Modal Federated Learning via Latent-Space Consensus Badi, Mohamed Issaid, Chaouki Ben Bennis, Mehdi Machine Learning Signal Processing Federated learning (FL) enables collaborative model training across distributed devices without sharing raw data, but applying FL to multi-modal settings introduces significant challenges. Clients typically possess heterogeneous modalities and model architectures, making it difficult to align feature spaces efficiently while preserving privacy and minimizing communication costs. To address this, we introduce CoMFed, a Communication-Efficient Multi-Modal Federated Learning framework that uses learnable projection matrices to generate compressed latent representations. A latent-space regularizer aligns these representations across clients, improving cross-modal consistency and robustness to outliers. Experiments on human activity recognition benchmarks show that CoMFed achieves competitive accuracy with minimal overhead. |
| title | Communication-Efficient and Robust Multi-Modal Federated Learning via Latent-Space Consensus |
| topic | Machine Learning Signal Processing |
| url | https://arxiv.org/abs/2603.19067 |