Multi-GPU Hybrid Particle-in-Cell Monte Carlo Simulations for Exascale Computing Systems

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Williams, Jeremy J., Trilaksono, Jordy, Costea, Stefan, Ju, Yi, Pennati, Luca, Ekelund, Jonah, Tskhakaya, David, Kos, Leon, Podolnik, Ales, Hromadka, Jakub, Malony, Allen D., Shende, Sameer, Dannert, Tilman, Jenko, Frank, Laure, Erwin, Markidis, Stefano
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914478550941696
author Williams, Jeremy J.
Trilaksono, Jordy
Costea, Stefan
Ju, Yi
Pennati, Luca
Ekelund, Jonah
Tskhakaya, David
Kos, Leon
Podolnik, Ales
Hromadka, Jakub
Malony, Allen D.
Shende, Sameer
Dannert, Tilman
Jenko, Frank
Laure, Erwin
Markidis, Stefano
author_facet Williams, Jeremy J.
Trilaksono, Jordy
Costea, Stefan
Ju, Yi
Pennati, Luca
Ekelund, Jonah
Tskhakaya, David
Kos, Leon
Podolnik, Ales
Hromadka, Jakub
Malony, Allen D.
Shende, Sameer
Dannert, Tilman
Jenko, Frank
Laure, Erwin
Markidis, Stefano
contents Particle-in-Cell (PIC) Monte Carlo (MC) simulations are central to plasma physics but face increasing challenges on heterogeneous HPC systems due to excessive data movement, synchronization overheads, and inefficient utilization of multiple accelerators. In this work, we present a portable, multi-GPU hybrid MPI+OpenMP implementation of BIT1 that enables scalable execution on both Nvidia and AMD accelerators through OpenMP target tasks with explicit dependencies to overlap computation and communication across devices. Portability is achieved through persistent device-resident memory, an optimized contiguous one-dimensional data layout, and a transition from unified to pinned host memory to improve large data-transfer efficiency, together with GPU Direct Memory Access (DMA) and runtime interoperability for direct device-pointer access. Standardized and scalable I/O is provided using openPMD and ADIOS2, supporting high-performance file I/O, in-memory data streaming, and in-situ analysis and visualization. Performance results on pre-exascale and exascale systems, including Frontier (OLCF-5) for up to 16,000 GPUs, demonstrate significant improvements in run time, scalability, and resource utilization for large-scale PIC MC simulations.
format Preprint
id arxiv_https___arxiv_org_abs_2603_24508
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Multi-GPU Hybrid Particle-in-Cell Monte Carlo Simulations for Exascale Computing Systems
Williams, Jeremy J.
Trilaksono, Jordy
Costea, Stefan
Ju, Yi
Pennati, Luca
Ekelund, Jonah
Tskhakaya, David
Kos, Leon
Podolnik, Ales
Hromadka, Jakub
Malony, Allen D.
Shende, Sameer
Dannert, Tilman
Jenko, Frank
Laure, Erwin
Markidis, Stefano
Plasma Physics
Distributed, Parallel, and Cluster Computing
Performance
Particle-in-Cell (PIC) Monte Carlo (MC) simulations are central to plasma physics but face increasing challenges on heterogeneous HPC systems due to excessive data movement, synchronization overheads, and inefficient utilization of multiple accelerators. In this work, we present a portable, multi-GPU hybrid MPI+OpenMP implementation of BIT1 that enables scalable execution on both Nvidia and AMD accelerators through OpenMP target tasks with explicit dependencies to overlap computation and communication across devices. Portability is achieved through persistent device-resident memory, an optimized contiguous one-dimensional data layout, and a transition from unified to pinned host memory to improve large data-transfer efficiency, together with GPU Direct Memory Access (DMA) and runtime interoperability for direct device-pointer access. Standardized and scalable I/O is provided using openPMD and ADIOS2, supporting high-performance file I/O, in-memory data streaming, and in-situ analysis and visualization. Performance results on pre-exascale and exascale systems, including Frontier (OLCF-5) for up to 16,000 GPUs, demonstrate significant improvements in run time, scalability, and resource utilization for large-scale PIC MC simulations.
title Multi-GPU Hybrid Particle-in-Cell Monte Carlo Simulations for Exascale Computing Systems
topic Plasma Physics
Distributed, Parallel, and Cluster Computing
Performance
url https://arxiv.org/abs/2603.24508