Performance-Portable Binary Neutron Star Mergers with AthenaK

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Fields, Jacob, Zhu, Hengrui, Radice, David, Stone, James M., Cook, William, Bernuzzi, Sebastiano, Daszuta, Boris
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909456270360576
author Fields, Jacob
Zhu, Hengrui
Radice, David
Stone, James M.
Cook, William
Bernuzzi, Sebastiano
Daszuta, Boris
author_facet Fields, Jacob
Zhu, Hengrui
Radice, David
Stone, James M.
Cook, William
Bernuzzi, Sebastiano
Daszuta, Boris
contents We introduce an extension to the AthenaK code for general-relativistic magnetohydrodynamics (GRMHD) in dynamical spacetimes using a 3+1 conservative Eulerian formulation. Like the fixed-spacetime GRMHD solver, we use standard finite-volume methods to evolve the fluid and a constrained transport scheme to preserve the divergence-free constraint for the magnetic field. We also utilize a first-order flux correction (FOFC) scheme to reduce the need for an artificial atmosphere and optionally enforce a maximum principle to improve robustness. We demonstrate the accuracy of AthenaK using a set of standard tests in flat and curved spacetimes. Using a SANE accretion disk around a Kerr black hole, we compare the new solver to the existing solver for stationary spacetimes using the so-called "HARM-like" formulation. We find that both formulations converge to similar results. We also include the first published binary neutron star (BNS) mergers performed on graphical processing units (GPUs). Thanks to the FOFC scheme, our BNS mergers maintain a relative error of $\mathcal{O}(10^{-11})$ or better in baryon mass conservation up to collapse. Finally, we perform scaling tests of AthenaK on OLCF Frontier, where we show excellent weak scaling of $\geq 80\%$ efficiency up to 32768 GPUs and $74\%$ up to 65536 GPUs for a GRMHD problem in dynamical spacetimes with six levels of mesh refinement. AthenaK achieves an order-of-magnitude speedup using GPUs compared to CPUs, demonstrating that it is suitable for performing numerical relativity problems on modern exascale resources.
format Preprint
id arxiv_https___arxiv_org_abs_2409_10384
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Performance-Portable Binary Neutron Star Mergers with AthenaK
Fields, Jacob
Zhu, Hengrui
Radice, David
Stone, James M.
Cook, William
Bernuzzi, Sebastiano
Daszuta, Boris
High Energy Astrophysical Phenomena
General Relativity and Quantum Cosmology
We introduce an extension to the AthenaK code for general-relativistic magnetohydrodynamics (GRMHD) in dynamical spacetimes using a 3+1 conservative Eulerian formulation. Like the fixed-spacetime GRMHD solver, we use standard finite-volume methods to evolve the fluid and a constrained transport scheme to preserve the divergence-free constraint for the magnetic field. We also utilize a first-order flux correction (FOFC) scheme to reduce the need for an artificial atmosphere and optionally enforce a maximum principle to improve robustness. We demonstrate the accuracy of AthenaK using a set of standard tests in flat and curved spacetimes. Using a SANE accretion disk around a Kerr black hole, we compare the new solver to the existing solver for stationary spacetimes using the so-called "HARM-like" formulation. We find that both formulations converge to similar results. We also include the first published binary neutron star (BNS) mergers performed on graphical processing units (GPUs). Thanks to the FOFC scheme, our BNS mergers maintain a relative error of $\mathcal{O}(10^{-11})$ or better in baryon mass conservation up to collapse. Finally, we perform scaling tests of AthenaK on OLCF Frontier, where we show excellent weak scaling of $\geq 80\%$ efficiency up to 32768 GPUs and $74\%$ up to 65536 GPUs for a GRMHD problem in dynamical spacetimes with six levels of mesh refinement. AthenaK achieves an order-of-magnitude speedup using GPUs compared to CPUs, demonstrating that it is suitable for performing numerical relativity problems on modern exascale resources.
title Performance-Portable Binary Neutron Star Mergers with AthenaK
topic High Energy Astrophysical Phenomena
General Relativity and Quantum Cosmology
url https://arxiv.org/abs/2409.10384