MFC 5.0: An exascale many-physics flow solver

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Wilfong, Benjamin, Berre, Henry A. Le, Radhakrishnan, Anand, Gupta, Ansh, Vickers, Daniel J., Vaca-Revelo, Diego, Adam, Dimitrios, Yu, Haocheng, Lee, Hyeoksu, Chreim, Jose Rodolfo, Barbosa, Mirelys Carcana, Zhang, Yanjun, Cisneros-Garibay, Esteban, Gnanaskandan, Aswin, Rodriguez Jr., Mauro, Budiardja, Reuben D., Abbott, Stephen, Colonius, Tim, Bryngelson, Spencer H.
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917138240897024
author Wilfong, Benjamin
Berre, Henry A. Le
Radhakrishnan, Anand
Gupta, Ansh
Vickers, Daniel J.
Vaca-Revelo, Diego
Adam, Dimitrios
Yu, Haocheng
Lee, Hyeoksu
Chreim, Jose Rodolfo
Barbosa, Mirelys Carcana
Zhang, Yanjun
Cisneros-Garibay, Esteban
Gnanaskandan, Aswin
Rodriguez Jr., Mauro
Budiardja, Reuben D.
Abbott, Stephen
Colonius, Tim
Bryngelson, Spencer H.
author_facet Wilfong, Benjamin
Berre, Henry A. Le
Radhakrishnan, Anand
Gupta, Ansh
Vickers, Daniel J.
Vaca-Revelo, Diego
Adam, Dimitrios
Yu, Haocheng
Lee, Hyeoksu
Chreim, Jose Rodolfo
Barbosa, Mirelys Carcana
Zhang, Yanjun
Cisneros-Garibay, Esteban
Gnanaskandan, Aswin
Rodriguez Jr., Mauro
Budiardja, Reuben D.
Abbott, Stephen
Colonius, Tim
Bryngelson, Spencer H.
contents Many problems of interest in engineering, medicine, and the fundamental sciences rely on high-fidelity flow simulation, making performant computational fluid dynamics solvers a mainstay of the open-source software community. Previous work, MFC 3.0, was published, documented, and made open-source by Bryngelson et al. CPC (2021) features numerous physical features, numerical methods, and scalable infrastructure. MFC 5.0 is a significant update to MFC 3.0, featuring a broad set of well-established and novel physical models and numerical methods, as well as the introduction of GPU and APU (or superchip) acceleration. We exhibit state-of-the-art performance and ideal scaling on the first two exascale supercomputers, OLCF's Frontier and LLNL's El Capitan. Combined with MFC's single-accelerator performance, MFC achieves exascale computation in practice and has achieved the largest-to-date public CFD simulation at 200 trillion grid points, earning it a 2025 ACM Gordon Bell Prize finalist. New physical features include the immersed boundary method, $N$-fluid phase change, Euler-Euler and Euler-Lagrange sub-grid bubble models, fluid-structure interaction, hypo- and hyper-elastic materials, chemically reacting flow, two-material surface tension, magnetohydrodynamics (MHD), and more. Numerical techniques now represent the current state-of-the-art, including general relaxation characteristic boundary conditions, WENO variants, Strang splitting for stiff sub-grid flow features, and low Mach number treatments. Weak scaling to tens of thousands of GPUs on OLCF's Summit and Frontier, and LLNL's El Capitan, achieves efficiencies within 5% of ideal to over 90% of their respective system sizes. Strong scaling results for a 16-fold increase in device count show parallel efficiencies exceeding 90% on OLCF Frontier.
format Preprint
id arxiv_https___arxiv_org_abs_2503_07953
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MFC 5.0: An exascale many-physics flow solver
Wilfong, Benjamin
Berre, Henry A. Le
Radhakrishnan, Anand
Gupta, Ansh
Vickers, Daniel J.
Vaca-Revelo, Diego
Adam, Dimitrios
Yu, Haocheng
Lee, Hyeoksu
Chreim, Jose Rodolfo
Barbosa, Mirelys Carcana
Zhang, Yanjun
Cisneros-Garibay, Esteban
Gnanaskandan, Aswin
Rodriguez Jr., Mauro
Budiardja, Reuben D.
Abbott, Stephen
Colonius, Tim
Bryngelson, Spencer H.
Fluid Dynamics
Distributed, Parallel, and Cluster Computing
Many problems of interest in engineering, medicine, and the fundamental sciences rely on high-fidelity flow simulation, making performant computational fluid dynamics solvers a mainstay of the open-source software community. Previous work, MFC 3.0, was published, documented, and made open-source by Bryngelson et al. CPC (2021) features numerous physical features, numerical methods, and scalable infrastructure. MFC 5.0 is a significant update to MFC 3.0, featuring a broad set of well-established and novel physical models and numerical methods, as well as the introduction of GPU and APU (or superchip) acceleration. We exhibit state-of-the-art performance and ideal scaling on the first two exascale supercomputers, OLCF's Frontier and LLNL's El Capitan. Combined with MFC's single-accelerator performance, MFC achieves exascale computation in practice and has achieved the largest-to-date public CFD simulation at 200 trillion grid points, earning it a 2025 ACM Gordon Bell Prize finalist. New physical features include the immersed boundary method, $N$-fluid phase change, Euler-Euler and Euler-Lagrange sub-grid bubble models, fluid-structure interaction, hypo- and hyper-elastic materials, chemically reacting flow, two-material surface tension, magnetohydrodynamics (MHD), and more. Numerical techniques now represent the current state-of-the-art, including general relaxation characteristic boundary conditions, WENO variants, Strang splitting for stiff sub-grid flow features, and low Mach number treatments. Weak scaling to tens of thousands of GPUs on OLCF's Summit and Frontier, and LLNL's El Capitan, achieves efficiencies within 5% of ideal to over 90% of their respective system sizes. Strong scaling results for a 16-fold increase in device count show parallel efficiencies exceeding 90% on OLCF Frontier.
title MFC 5.0: An exascale many-physics flow solver
topic Fluid Dynamics
Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2503.07953