Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2507.07765 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913936334389248 |
|---|---|
| author | Kryś, Jakub Sharma, Yashvardhan Egan, Janet |
| author_facet | Kryś, Jakub Sharma, Yashvardhan Egan, Janet |
| contents | Advances in low-communication training algorithms are enabling a shift from centralised model training to compute setups that are either distributed across multiple clusters or decentralised via community-driven contributions. This paper distinguishes these two scenarios - distributed and decentralised training - which are little understood and often conflated in policy discourse. We discuss how they could impact technical AI governance through an increased risk of compute structuring, capability proliferation, and the erosion of detectability and shutdownability. While these trends foreshadow a possible new paradigm that could challenge key assumptions of compute governance, we emphasise that certain policy levers, like export controls, remain relevant. We also acknowledge potential benefits of decentralised AI, including privacy-preserving training runs that could unlock access to more data, and mitigating harmful power concentration. Our goal is to support more precise policymaking around compute, capability proliferation, and decentralised AI development. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_07765 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Distributed and Decentralised Training: Technical Governance Challenges in a Shifting AI Landscape Kryś, Jakub Sharma, Yashvardhan Egan, Janet Computers and Society Machine Learning Advances in low-communication training algorithms are enabling a shift from centralised model training to compute setups that are either distributed across multiple clusters or decentralised via community-driven contributions. This paper distinguishes these two scenarios - distributed and decentralised training - which are little understood and often conflated in policy discourse. We discuss how they could impact technical AI governance through an increased risk of compute structuring, capability proliferation, and the erosion of detectability and shutdownability. While these trends foreshadow a possible new paradigm that could challenge key assumptions of compute governance, we emphasise that certain policy levers, like export controls, remain relevant. We also acknowledge potential benefits of decentralised AI, including privacy-preserving training runs that could unlock access to more data, and mitigating harmful power concentration. Our goal is to support more precise policymaking around compute, capability proliferation, and decentralised AI development. |
| title | Distributed and Decentralised Training: Technical Governance Challenges in a Shifting AI Landscape |
| topic | Computers and Society Machine Learning |
| url | https://arxiv.org/abs/2507.07765 |