The Hitchhiker's Guide to Programming and Optimizing Cache Coherent Heterogeneous Systems: CXL, NVLink-C2C, and AMD Infinity Fabric

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Wang, Zixuan, Mahar, Suyash, Li, Luyi, Park, Jangseon, Kim, Jinpyo, Michailidis, Theodore, Pan, Yue, Shen, Mingyao, Rosing, Tajana, Tullsen, Dean, Swanson, Steven, Zhao, Jishen
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909687540088832
author Wang, Zixuan
Mahar, Suyash
Li, Luyi
Park, Jangseon
Kim, Jinpyo
Michailidis, Theodore
Pan, Yue
Shen, Mingyao
Rosing, Tajana
Tullsen, Dean
Swanson, Steven
Zhao, Jishen
author_facet Wang, Zixuan
Mahar, Suyash
Li, Luyi
Park, Jangseon
Kim, Jinpyo
Michailidis, Theodore
Pan, Yue
Shen, Mingyao
Rosing, Tajana
Tullsen, Dean
Swanson, Steven
Zhao, Jishen
contents We present a thorough analysis of the use of modern heterogeneous systems interconnected by various cachecoherent links, including CXL, NVLink-C2C, and Infinity Fabric. We studied a wide range of server systems that combined CPUs from different vendors and various types of coherent memory devices, including CXL memory expander, CXL pool, CXL shared memory, GH200 GPU, and AMD MI300a HBM. For this study, we developed a heterogeneous memory benchmark suite, Heimdall, to profile the performance of such heterogeneous systems and present a detailed performance comparison across systems. By leveraging H E I M DA L L , we unveiled the detailed architecture design in these systems, drew observations on optimizing performance for workloads, and pointed out directions for future development of cache coherent heterogeneous systems.
format Preprint
id arxiv_https___arxiv_org_abs_2411_02814
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle The Hitchhiker's Guide to Programming and Optimizing Cache Coherent Heterogeneous Systems: CXL, NVLink-C2C, and AMD Infinity Fabric
Wang, Zixuan
Mahar, Suyash
Li, Luyi
Park, Jangseon
Kim, Jinpyo
Michailidis, Theodore
Pan, Yue
Shen, Mingyao
Rosing, Tajana
Tullsen, Dean
Swanson, Steven
Zhao, Jishen
Performance
Hardware Architecture
Distributed, Parallel, and Cluster Computing
Operating Systems
We present a thorough analysis of the use of modern heterogeneous systems interconnected by various cachecoherent links, including CXL, NVLink-C2C, and Infinity Fabric. We studied a wide range of server systems that combined CPUs from different vendors and various types of coherent memory devices, including CXL memory expander, CXL pool, CXL shared memory, GH200 GPU, and AMD MI300a HBM. For this study, we developed a heterogeneous memory benchmark suite, Heimdall, to profile the performance of such heterogeneous systems and present a detailed performance comparison across systems. By leveraging H E I M DA L L , we unveiled the detailed architecture design in these systems, drew observations on optimizing performance for workloads, and pointed out directions for future development of cache coherent heterogeneous systems.
title The Hitchhiker's Guide to Programming and Optimizing Cache Coherent Heterogeneous Systems: CXL, NVLink-C2C, and AMD Infinity Fabric
topic Performance
Hardware Architecture
Distributed, Parallel, and Cluster Computing
Operating Systems
url https://arxiv.org/abs/2411.02814