Distributed Learning and Inference Systems: A Networking Perspective
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909628575514624 |
|---|---|
| author | Moussa, Hesham G. Akhavain, Arashmid Hosseini, S. Maryam McCormick, Bill |
| author_facet | Moussa, Hesham G. Akhavain, Arashmid Hosseini, S. Maryam McCormick, Bill |
| contents | Machine learning models have achieved, and in some cases surpassed, human-level performance in various tasks, mainly through centralized training of static models and the use of large models stored in centralized clouds for inference. However, this centralized approach has several drawbacks, including privacy concerns, high storage demands, a single point of failure, and significant computing requirements. These challenges have driven interest in developing alternative decentralized and distributed methods for AI training and inference. Distribution introduces additional complexity, as it requires managing multiple moving parts. To address these complexities and fill a gap in the development of distributed AI systems, this work proposes a novel framework, Data and Dynamics-Aware Inference and Training Networks (DA-ITN). The different components of DA-ITN and their functions are explored, and the associated challenges and research areas are highlighted. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_05323 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Distributed Learning and Inference Systems: A Networking Perspective Moussa, Hesham G. Akhavain, Arashmid Hosseini, S. Maryam McCormick, Bill Machine Learning Networking and Internet Architecture Machine learning models have achieved, and in some cases surpassed, human-level performance in various tasks, mainly through centralized training of static models and the use of large models stored in centralized clouds for inference. However, this centralized approach has several drawbacks, including privacy concerns, high storage demands, a single point of failure, and significant computing requirements. These challenges have driven interest in developing alternative decentralized and distributed methods for AI training and inference. Distribution introduces additional complexity, as it requires managing multiple moving parts. To address these complexities and fill a gap in the development of distributed AI systems, this work proposes a novel framework, Data and Dynamics-Aware Inference and Training Networks (DA-ITN). The different components of DA-ITN and their functions are explored, and the associated challenges and research areas are highlighted. |
| title | Distributed Learning and Inference Systems: A Networking Perspective |
| topic | Machine Learning Networking and Internet Architecture |
| url | https://arxiv.org/abs/2501.05323 |