Towards Decentralized and Sustainable Foundation Model Training with the Edge
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915369611952128 |
|---|---|
| author | Xue, Leyang Madhyastha, Meghana Burns, Randal Lee, Myungjin Marina, Mahesh K. |
| author_facet | Xue, Leyang Madhyastha, Meghana Burns, Randal Lee, Myungjin Marina, Mahesh K. |
| contents | Foundation models are at the forefront of AI research, appealing for their ability to learn from vast datasets and cater to diverse tasks. Yet, their significant computational demands raise issues of environmental impact and the risk of centralized control in their development. We put forward a vision towards decentralized and sustainable foundation model training that leverages the collective compute of sparingly used connected edge AI devices. We present the rationale behind our vision, particularly in support of its sustainability benefit. We further outline a set of challenges that need to be addressed to turn this vision into reality. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_01803 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Towards Decentralized and Sustainable Foundation Model Training with the Edge Xue, Leyang Madhyastha, Meghana Burns, Randal Lee, Myungjin Marina, Mahesh K. Machine Learning Foundation models are at the forefront of AI research, appealing for their ability to learn from vast datasets and cater to diverse tasks. Yet, their significant computational demands raise issues of environmental impact and the risk of centralized control in their development. We put forward a vision towards decentralized and sustainable foundation model training that leverages the collective compute of sparingly used connected edge AI devices. We present the rationale behind our vision, particularly in support of its sustainability benefit. We further outline a set of challenges that need to be addressed to turn this vision into reality. |
| title | Towards Decentralized and Sustainable Foundation Model Training with the Edge |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2507.01803 |