Leveraging Caliper and Benchpark to Analyze MPI Communication Patterns: Insights from AMG2023, Kripke, and Laghos

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Nansamba, Grace, Namugwanya, Evelyn, Boehme, David, Yokelson, Dewi, Shipley, Riley, Schafer, Derek, McKinsey, Michael, Pearce, Olga, Skjellum, Anthony
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912510901223424
author Nansamba, Grace
Namugwanya, Evelyn
Boehme, David
Yokelson, Dewi
Shipley, Riley
Schafer, Derek
McKinsey, Michael
Pearce, Olga
Skjellum, Anthony
author_facet Nansamba, Grace
Namugwanya, Evelyn
Boehme, David
Yokelson, Dewi
Shipley, Riley
Schafer, Derek
McKinsey, Michael
Pearce, Olga
Skjellum, Anthony
contents We introduce ``communication regions'' into the widely used Caliper HPC profiling tool. A communication region is an annotation enabling capture of metrics about the data being communicated (including statistics of these metrics), and metrics about the MPI processes involved in the communications, something not previously possible in Caliper. We explore the utility of communication regions with three representative modeling and simulation applications, AMG2023, Kripke, and Laghos, all part of the comprehensive Benchpark suite that includes Caliper annotations. Enhanced Caliper reveals detailed communication behaviors. Using Caliper and Thicket in tandem, we create new visualizations of MPI communication patterns, including halo exchanges. Our findings reveal communication bottlenecks and detailed behaviors, indicating significant utility of the special-regions addition to Caliper. The comparative scaling behavior of both CPU and GPU oriented systems are shown; we are able to look at different regions within a given application, and see how scalability and message-traffic metrics differ.
format Preprint
id arxiv_https___arxiv_org_abs_2507_22372
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Leveraging Caliper and Benchpark to Analyze MPI Communication Patterns: Insights from AMG2023, Kripke, and Laghos
Nansamba, Grace
Namugwanya, Evelyn
Boehme, David
Yokelson, Dewi
Shipley, Riley
Schafer, Derek
McKinsey, Michael
Pearce, Olga
Skjellum, Anthony
Distributed, Parallel, and Cluster Computing
We introduce ``communication regions'' into the widely used Caliper HPC profiling tool. A communication region is an annotation enabling capture of metrics about the data being communicated (including statistics of these metrics), and metrics about the MPI processes involved in the communications, something not previously possible in Caliper. We explore the utility of communication regions with three representative modeling and simulation applications, AMG2023, Kripke, and Laghos, all part of the comprehensive Benchpark suite that includes Caliper annotations. Enhanced Caliper reveals detailed communication behaviors. Using Caliper and Thicket in tandem, we create new visualizations of MPI communication patterns, including halo exchanges. Our findings reveal communication bottlenecks and detailed behaviors, indicating significant utility of the special-regions addition to Caliper. The comparative scaling behavior of both CPU and GPU oriented systems are shown; we are able to look at different regions within a given application, and see how scalability and message-traffic metrics differ.
title Leveraging Caliper and Benchpark to Analyze MPI Communication Patterns: Insights from AMG2023, Kripke, and Laghos
topic Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2507.22372