Accelerating High-Order Finite Element Simulations at Extreme Scale with FP64 Tensor Cores

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Tu, Jiqun, Karlin, Ian, Camier, John, Dobrev, Veselin, Kolev, Tzanio, Henneking, Stefan, Ghattas, Omar
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917397659648000
author Tu, Jiqun
Karlin, Ian
Camier, John
Dobrev, Veselin
Kolev, Tzanio
Henneking, Stefan
Ghattas, Omar
author_facet Tu, Jiqun
Karlin, Ian
Camier, John
Dobrev, Veselin
Kolev, Tzanio
Henneking, Stefan
Ghattas, Omar
contents Finite element simulations play a critical role in a wide range of applications, from automotive design to tsunami modeling and computational electromagnetics. Performing these simulations efficiently at the high resolutions needed for practical applications and scientific insights necessitates the use of high-order methods and large-scale supercomputing. While much progress has been made in porting finite element codes to GPU systems in recent years, additional improvements in the efficiency and computational speed of GPU-accelerated high-order finite element simulations are in constant demand. In this paper, we demonstrate that the FP64 tensor cores on NVIDIA GPUs can be used to further accelerate such simulations, achieving significant speedups in key kernels of MFEM, a scalable open-source finite element library widely used in HPC applications. By integrating FP64 tensor cores with kernel fusion optimizations, we were able to achieve up to 2$\times$ performance gains and up to 83% energy efficiency gains on NVIDIA's Grace Hopper GH200 and Grace Blackwell GB200 architectures. To the best of our knowledge, this is the first time that FP64 tensor cores have been directly programmed to accelerate large-scale finite element scientific computing applications. We demonstrate the performance of the optimized kernels at exascale by showing near-perfect weak scaling efficiency and 90% strong scaling efficiency across nearly 10,000 GPUs on the Alps system. The new algorithms and MFEM enhancements directly benefit complex production codes, including the 2025 Gordon Bell Prize-winning application for real-time tsunami forecasting.
format Preprint
id arxiv_https___arxiv_org_abs_2603_09038
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Accelerating High-Order Finite Element Simulations at Extreme Scale with FP64 Tensor Cores
Tu, Jiqun
Karlin, Ian
Camier, John
Dobrev, Veselin
Kolev, Tzanio
Henneking, Stefan
Ghattas, Omar
Distributed, Parallel, and Cluster Computing
Mathematical Software
Performance
Finite element simulations play a critical role in a wide range of applications, from automotive design to tsunami modeling and computational electromagnetics. Performing these simulations efficiently at the high resolutions needed for practical applications and scientific insights necessitates the use of high-order methods and large-scale supercomputing. While much progress has been made in porting finite element codes to GPU systems in recent years, additional improvements in the efficiency and computational speed of GPU-accelerated high-order finite element simulations are in constant demand. In this paper, we demonstrate that the FP64 tensor cores on NVIDIA GPUs can be used to further accelerate such simulations, achieving significant speedups in key kernels of MFEM, a scalable open-source finite element library widely used in HPC applications. By integrating FP64 tensor cores with kernel fusion optimizations, we were able to achieve up to 2$\times$ performance gains and up to 83% energy efficiency gains on NVIDIA's Grace Hopper GH200 and Grace Blackwell GB200 architectures. To the best of our knowledge, this is the first time that FP64 tensor cores have been directly programmed to accelerate large-scale finite element scientific computing applications. We demonstrate the performance of the optimized kernels at exascale by showing near-perfect weak scaling efficiency and 90% strong scaling efficiency across nearly 10,000 GPUs on the Alps system. The new algorithms and MFEM enhancements directly benefit complex production codes, including the 2025 Gordon Bell Prize-winning application for real-time tsunami forecasting.
title Accelerating High-Order Finite Element Simulations at Extreme Scale with FP64 Tensor Cores
topic Distributed, Parallel, and Cluster Computing
Mathematical Software
Performance
url https://arxiv.org/abs/2603.09038