Benchmarking Machine Learning Applications on Heterogeneous Architecture using Reframe
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909181125066752 |
|---|---|
| author | Rae, Christopher Lee, Joseph K. L. Richings, James Weiland, Michele |
| author_facet | Rae, Christopher Lee, Joseph K. L. Richings, James Weiland, Michele |
| contents | With the rapid increase in machine learning workloads performed on HPC systems, it is beneficial to regularly perform machine learning specific benchmarks to monitor performance and identify issues. Furthermore, as part of the Edinburgh International Data Facility, EPCC currently hosts a wide range of machine learning accelerators including Nvidia GPUs, the Graphcore Bow Pod64 and Cerebras CS-2, which are managed via Kubernetes and Slurm. We extended the Reframe framework to support the Kubernetes scheduler backend, and utilise Reframe to perform machine learning benchmarks, and we discuss the preliminary results collected and challenges involved in integrating Reframe across multiple platforms and architectures. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2404_10536 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Benchmarking Machine Learning Applications on Heterogeneous Architecture using Reframe Rae, Christopher Lee, Joseph K. L. Richings, James Weiland, Michele Distributed, Parallel, and Cluster Computing With the rapid increase in machine learning workloads performed on HPC systems, it is beneficial to regularly perform machine learning specific benchmarks to monitor performance and identify issues. Furthermore, as part of the Edinburgh International Data Facility, EPCC currently hosts a wide range of machine learning accelerators including Nvidia GPUs, the Graphcore Bow Pod64 and Cerebras CS-2, which are managed via Kubernetes and Slurm. We extended the Reframe framework to support the Kubernetes scheduler backend, and utilise Reframe to perform machine learning benchmarks, and we discuss the preliminary results collected and challenges involved in integrating Reframe across multiple platforms and architectures. |
| title | Benchmarking Machine Learning Applications on Heterogeneous Architecture using Reframe |
| topic | Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2404.10536 |