OpenACC offloading of the MFC compressible multiphase flow solver on AMD and NVIDIA GPUs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wilfong, Benjamin, Radhakrishnan, Anand, Berre, Henry A. Le, Abbott, Steve, Budiardja, Reuben D., Bryngelson, Spencer H.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918024772059136
author Wilfong, Benjamin
Radhakrishnan, Anand
Berre, Henry A. Le
Abbott, Steve
Budiardja, Reuben D.
Bryngelson, Spencer H.
author_facet Wilfong, Benjamin
Radhakrishnan, Anand
Berre, Henry A. Le
Abbott, Steve
Budiardja, Reuben D.
Bryngelson, Spencer H.
contents GPUs are the heart of the latest generations of supercomputers. We efficiently accelerate a compressible multiphase flow solver via OpenACC on NVIDIA and AMD Instinct GPUs. Optimization is accomplished by specifying the directive clauses 'gang vector' and 'collapse'. Further speedups of six and ten times are achieved by packing user-defined types into coalesced multidimensional arrays and manual inlining via metaprogramming. Additional optimizations yield seven-times speedup in array packing and thirty-times speedup of select kernels on Frontier. Weak scaling efficiencies of 97% and 95% are observed when scaling to 50% of Summit and 95% of Frontier. Strong scaling efficiencies of 84% and 81% are observed when increasing the device count by a factor of 8 and 16 on V100 and MI250X hardware. The strong scaling efficiency of AMD's MI250X increases to 92% when increasing the device count by a factor of 16 when GPU-aware MPI is used for communication.
format Preprint
id arxiv_https___arxiv_org_abs_2409_10729
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle OpenACC offloading of the MFC compressible multiphase flow solver on AMD and NVIDIA GPUs
Wilfong, Benjamin
Radhakrishnan, Anand
Berre, Henry A. Le
Abbott, Steve
Budiardja, Reuben D.
Bryngelson, Spencer H.
Fluid Dynamics
Mathematical Software
Computational Physics
GPUs are the heart of the latest generations of supercomputers. We efficiently accelerate a compressible multiphase flow solver via OpenACC on NVIDIA and AMD Instinct GPUs. Optimization is accomplished by specifying the directive clauses 'gang vector' and 'collapse'. Further speedups of six and ten times are achieved by packing user-defined types into coalesced multidimensional arrays and manual inlining via metaprogramming. Additional optimizations yield seven-times speedup in array packing and thirty-times speedup of select kernels on Frontier. Weak scaling efficiencies of 97% and 95% are observed when scaling to 50% of Summit and 95% of Frontier. Strong scaling efficiencies of 84% and 81% are observed when increasing the device count by a factor of 8 and 16 on V100 and MI250X hardware. The strong scaling efficiency of AMD's MI250X increases to 92% when increasing the device count by a factor of 16 when GPU-aware MPI is used for communication.
title OpenACC offloading of the MFC compressible multiphase flow solver on AMD and NVIDIA GPUs
topic Fluid Dynamics
Mathematical Software
Computational Physics
url https://arxiv.org/abs/2409.10729