A Mess of Memory System Benchmarking, Simulation and Application Profiling

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Esmaili-Dokht, Pouya, Sgherzi, Francesco, Girelli, Valeria Soldera, Boixaderas, Isaac, Carmin, Mariana, Monemi, Alireza, Armejach, Adria, Mercadal, Estanislao, Llort, German, Radojkovic, Petar, Moreto, Miquel, Gimenez, Judit, Martorell, Xavier, Ayguade, Eduard, Labarta, Jesus, Confalonieri, Emanuele, Dubey, Rishabh, Adlard, Jason
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913600381124608
author Esmaili-Dokht, Pouya
Sgherzi, Francesco
Girelli, Valeria Soldera
Boixaderas, Isaac
Carmin, Mariana
Monemi, Alireza
Armejach, Adria
Mercadal, Estanislao
Llort, German
Radojkovic, Petar
Moreto, Miquel
Gimenez, Judit
Martorell, Xavier
Ayguade, Eduard
Labarta, Jesus
Confalonieri, Emanuele
Dubey, Rishabh
Adlard, Jason
author_facet Esmaili-Dokht, Pouya
Sgherzi, Francesco
Girelli, Valeria Soldera
Boixaderas, Isaac
Carmin, Mariana
Monemi, Alireza
Armejach, Adria
Mercadal, Estanislao
Llort, German
Radojkovic, Petar
Moreto, Miquel
Gimenez, Judit
Martorell, Xavier
Ayguade, Eduard
Labarta, Jesus
Confalonieri, Emanuele
Dubey, Rishabh
Adlard, Jason
contents The Memory stress (Mess) framework provides a unified view of the memory system benchmarking, simulation and application profiling. The Mess benchmark provides a holistic and detailed memory system characterization. It is based on hundreds of measurements that are represented as a family of bandwidth--latency curves. The benchmark increases the coverage of all the previous tools and leads to new findings in the behavior of the actual and simulated memory systems. We deploy the Mess benchmark to characterize Intel, AMD, IBM, Fujitsu, Amazon and NVIDIA servers with DDR4, DDR5, HBM2 and HBM2E memory. The Mess memory simulator uses bandwidth--latency concept for the memory performance simulation. We integrate Mess with widely-used CPUs simulators enabling modeling of all high-end memory technologies. The Mess simulator is fast, easy to integrate and it closely matches the actual system performance. By design, it enables a quick adoption of new memory technologies in hardware simulators. Finally, the Mess application profiling positions the application in the bandwidth--latency space of the target memory system. This information can be correlated with other application runtime activities and the source code, leading to a better overall understanding of the application's behavior. The current Mess benchmark release covers all major CPU and GPU ISAs, x86, ARM, Power, RISC-V, and NVIDIA's PTX. We also release as open source the ZSim, gem5 and OpenPiton Metro-MPI integrated with the Mess simulator for DDR4, DDR5, Optane, HBM2, HBM2E and CXL memory expanders. The Mess application profiling is already integrated into a suite of production HPC performance analysis tools.
format Preprint
id arxiv_https___arxiv_org_abs_2405_10170
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A Mess of Memory System Benchmarking, Simulation and Application Profiling
Esmaili-Dokht, Pouya
Sgherzi, Francesco
Girelli, Valeria Soldera
Boixaderas, Isaac
Carmin, Mariana
Monemi, Alireza
Armejach, Adria
Mercadal, Estanislao
Llort, German
Radojkovic, Petar
Moreto, Miquel
Gimenez, Judit
Martorell, Xavier
Ayguade, Eduard
Labarta, Jesus
Confalonieri, Emanuele
Dubey, Rishabh
Adlard, Jason
Hardware Architecture
The Memory stress (Mess) framework provides a unified view of the memory system benchmarking, simulation and application profiling. The Mess benchmark provides a holistic and detailed memory system characterization. It is based on hundreds of measurements that are represented as a family of bandwidth--latency curves. The benchmark increases the coverage of all the previous tools and leads to new findings in the behavior of the actual and simulated memory systems. We deploy the Mess benchmark to characterize Intel, AMD, IBM, Fujitsu, Amazon and NVIDIA servers with DDR4, DDR5, HBM2 and HBM2E memory. The Mess memory simulator uses bandwidth--latency concept for the memory performance simulation. We integrate Mess with widely-used CPUs simulators enabling modeling of all high-end memory technologies. The Mess simulator is fast, easy to integrate and it closely matches the actual system performance. By design, it enables a quick adoption of new memory technologies in hardware simulators. Finally, the Mess application profiling positions the application in the bandwidth--latency space of the target memory system. This information can be correlated with other application runtime activities and the source code, leading to a better overall understanding of the application's behavior. The current Mess benchmark release covers all major CPU and GPU ISAs, x86, ARM, Power, RISC-V, and NVIDIA's PTX. We also release as open source the ZSim, gem5 and OpenPiton Metro-MPI integrated with the Mess simulator for DDR4, DDR5, Optane, HBM2, HBM2E and CXL memory expanders. The Mess application profiling is already integrated into a suite of production HPC performance analysis tools.
title A Mess of Memory System Benchmarking, Simulation and Application Profiling
topic Hardware Architecture
url https://arxiv.org/abs/2405.10170