The Hitchhiker's Guide to Programming and Optimizing Cache Coherent Heterogeneous Systems: CXL, NVLink-C2C, and AMD Infinity Fabric
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909687540088832 |
|---|---|
| author | Wang, Zixuan Mahar, Suyash Li, Luyi Park, Jangseon Kim, Jinpyo Michailidis, Theodore Pan, Yue Shen, Mingyao Rosing, Tajana Tullsen, Dean Swanson, Steven Zhao, Jishen |
| author_facet | Wang, Zixuan Mahar, Suyash Li, Luyi Park, Jangseon Kim, Jinpyo Michailidis, Theodore Pan, Yue Shen, Mingyao Rosing, Tajana Tullsen, Dean Swanson, Steven Zhao, Jishen |
| contents | We present a thorough analysis of the use of modern heterogeneous systems interconnected by various cachecoherent links, including CXL, NVLink-C2C, and Infinity Fabric. We studied a wide range of server systems that combined CPUs from different vendors and various types of coherent memory devices, including CXL memory expander, CXL pool, CXL shared memory, GH200 GPU, and AMD MI300a HBM. For this study, we developed a heterogeneous memory benchmark suite, Heimdall, to profile the performance of such heterogeneous systems and present a detailed performance comparison across systems. By leveraging H E I M DA L L , we unveiled the detailed architecture design in these systems, drew observations on optimizing performance for workloads, and pointed out directions for future development of cache coherent heterogeneous systems. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_02814 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | The Hitchhiker's Guide to Programming and Optimizing Cache Coherent Heterogeneous Systems: CXL, NVLink-C2C, and AMD Infinity Fabric Wang, Zixuan Mahar, Suyash Li, Luyi Park, Jangseon Kim, Jinpyo Michailidis, Theodore Pan, Yue Shen, Mingyao Rosing, Tajana Tullsen, Dean Swanson, Steven Zhao, Jishen Performance Hardware Architecture Distributed, Parallel, and Cluster Computing Operating Systems We present a thorough analysis of the use of modern heterogeneous systems interconnected by various cachecoherent links, including CXL, NVLink-C2C, and Infinity Fabric. We studied a wide range of server systems that combined CPUs from different vendors and various types of coherent memory devices, including CXL memory expander, CXL pool, CXL shared memory, GH200 GPU, and AMD MI300a HBM. For this study, we developed a heterogeneous memory benchmark suite, Heimdall, to profile the performance of such heterogeneous systems and present a detailed performance comparison across systems. By leveraging H E I M DA L L , we unveiled the detailed architecture design in these systems, drew observations on optimizing performance for workloads, and pointed out directions for future development of cache coherent heterogeneous systems. |
| title | The Hitchhiker's Guide to Programming and Optimizing Cache Coherent Heterogeneous Systems: CXL, NVLink-C2C, and AMD Infinity Fabric |
| topic | Performance Hardware Architecture Distributed, Parallel, and Cluster Computing Operating Systems |
| url | https://arxiv.org/abs/2411.02814 |