On the energy efficiency of sparse matrix computations on multi-GPU clusters

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Bernaschi, Massimo, Celestini, Alessandro, D'Ambra, Pasqua, Richelli, Giorgio
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915938342797312
author Bernaschi, Massimo
Celestini, Alessandro
D'Ambra, Pasqua
Richelli, Giorgio
author_facet Bernaschi, Massimo
Celestini, Alessandro
D'Ambra, Pasqua
Richelli, Giorgio
contents We investigate the energy efficiency of a library designed for parallel computations with sparse matrices. The library leverages high-performance, energy-efficient Graphics Processing Unit (GPU) accelerators to enable large-scale scientific applications. Our primary development objective was to maximize parallel performance and scalability in solving sparse linear systems whose dimensions far exceed the memory capacity of a single node. To this end, we devised methods that expose a high degree of parallelism while optimizing algorithmic implementations for efficient multi-GPU usage. Previous work has already demonstrated the library's performance efficiency on large-scale systems comprising thousands of NVIDIA GPUs, achieving improvements over state-of-the-art solutions. In this paper, we extend those results by providing energy profiles that address the growing sustainability requirements of modern HPC platforms. We present our methodology and tools for accurate runtime energy measurements of the library's core components and discuss the findings. Our results confirm that optimizing GPU computations and minimizing data movement across memory and computing nodes reduces both time-to-solution and energy consumption. Moreover, we show that the library delivers substantial advantages over comparable software frameworks on standard benchmarks.
format Preprint
id arxiv_https___arxiv_org_abs_2510_02878
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle On the energy efficiency of sparse matrix computations on multi-GPU clusters
Bernaschi, Massimo
Celestini, Alessandro
D'Ambra, Pasqua
Richelli, Giorgio
Distributed, Parallel, and Cluster Computing
Mathematical Software
Performance
We investigate the energy efficiency of a library designed for parallel computations with sparse matrices. The library leverages high-performance, energy-efficient Graphics Processing Unit (GPU) accelerators to enable large-scale scientific applications. Our primary development objective was to maximize parallel performance and scalability in solving sparse linear systems whose dimensions far exceed the memory capacity of a single node. To this end, we devised methods that expose a high degree of parallelism while optimizing algorithmic implementations for efficient multi-GPU usage. Previous work has already demonstrated the library's performance efficiency on large-scale systems comprising thousands of NVIDIA GPUs, achieving improvements over state-of-the-art solutions. In this paper, we extend those results by providing energy profiles that address the growing sustainability requirements of modern HPC platforms. We present our methodology and tools for accurate runtime energy measurements of the library's core components and discuss the findings. Our results confirm that optimizing GPU computations and minimizing data movement across memory and computing nodes reduces both time-to-solution and energy consumption. Moreover, we show that the library delivers substantial advantages over comparable software frameworks on standard benchmarks.
title On the energy efficiency of sparse matrix computations on multi-GPU clusters
topic Distributed, Parallel, and Cluster Computing
Mathematical Software
Performance
url https://arxiv.org/abs/2510.02878