An Open-Source HW-SW Co-Development Framework Enabling Efficient Multi-Accelerator Systems
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866913998593589248 |
|---|---|
| author | Antonio, Ryan Albert Dumoulin, Joren Yi, Xiaoling Van Delm, Josse Deng, Yunhao Paim, Guilherme Verhelst, Marian |
| author_facet | Antonio, Ryan Albert Dumoulin, Joren Yi, Xiaoling Van Delm, Josse Deng, Yunhao Paim, Guilherme Verhelst, Marian |
| contents | Heterogeneous accelerator-centric compute clusters are emerging as efficient solutions for diverse AI workloads. However, current integration strategies often compromise data movement efficiency and encounter compatibility issues in hardware and software. This prevents a unified approach that balances performance and ease of use. To this end, we present SNAX, an open-source integrated HW-SW framework enabling efficient multi-accelerator platforms through a novel hybrid-coupling scheme, consisting of loosely coupled asynchronous control and tightly coupled data access. SNAX brings reusable hardware modules designed to enhance compute accelerator utilization, and its customizable MLIR-based compiler to automate key system management tasks, jointly enabling rapid development and deployment of customized multi-accelerator compute clusters. Through extensive experimentation, we demonstrate SNAX's efficiency and flexibility in a low-power heterogeneous SoC. Accelerators can easily be integrated and programmed to achieve > 10x improvement in neural network performance compared to other accelerator systems while maintaining accelerator utilization of > 90% in full system operation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_14582 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | An Open-Source HW-SW Co-Development Framework Enabling Efficient Multi-Accelerator Systems Antonio, Ryan Albert Dumoulin, Joren Yi, Xiaoling Van Delm, Josse Deng, Yunhao Paim, Guilherme Verhelst, Marian Hardware Architecture Artificial Intelligence Heterogeneous accelerator-centric compute clusters are emerging as efficient solutions for diverse AI workloads. However, current integration strategies often compromise data movement efficiency and encounter compatibility issues in hardware and software. This prevents a unified approach that balances performance and ease of use. To this end, we present SNAX, an open-source integrated HW-SW framework enabling efficient multi-accelerator platforms through a novel hybrid-coupling scheme, consisting of loosely coupled asynchronous control and tightly coupled data access. SNAX brings reusable hardware modules designed to enhance compute accelerator utilization, and its customizable MLIR-based compiler to automate key system management tasks, jointly enabling rapid development and deployment of customized multi-accelerator compute clusters. Through extensive experimentation, we demonstrate SNAX's efficiency and flexibility in a low-power heterogeneous SoC. Accelerators can easily be integrated and programmed to achieve > 10x improvement in neural network performance compared to other accelerator systems while maintaining accelerator utilization of > 90% in full system operation. |
| title | An Open-Source HW-SW Co-Development Framework Enabling Efficient Multi-Accelerator Systems |
| topic | Hardware Architecture Artificial Intelligence |
| url | https://arxiv.org/abs/2508.14582 |