PETSc/TAO Developments for GPU-Based Early Exascale Systems

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Mills, Richard Tran, Adams, Mark, Balay, Satish, Brown, Jed, Faibussowitsch, Jacob, Isaac, Toby, Knepley, Matthew, Munson, Todd, Suh, Hansol, Zampini, Stefano, Zhang, Hong, Zhang, Junchao
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915021307510784
author Mills, Richard Tran
Adams, Mark
Balay, Satish
Brown, Jed
Faibussowitsch, Jacob
Isaac, Toby
Knepley, Matthew
Munson, Todd
Suh, Hansol
Zampini, Stefano
Zhang, Hong
Zhang, Junchao
author_facet Mills, Richard Tran
Adams, Mark
Balay, Satish
Brown, Jed
Faibussowitsch, Jacob
Isaac, Toby
Knepley, Matthew
Munson, Todd
Suh, Hansol
Zampini, Stefano
Zhang, Hong
Zhang, Junchao
contents The Portable Extensible Toolkit for Scientific Computation (PETSc) library provides scalable solvers for nonlinear time-dependent differential and algebraic equations and for numerical optimization via the Toolkit for Advanced Optimization (TAO). PETSc is used in dozens of scientific fields and is an important building block for many simulation codes. During the U.S. Department of Energy's Exascale Computing Project, the PETSc team has made substantial efforts to enable efficient utilization of the massive fine-grain parallelism present within exascale compute nodes and to enable performance portability across exascale architectures. We recap some of the challenges that designers of numerical libraries face in such an endeavor, and then discuss the many developments we have made, which include the addition of new GPU backends, features supporting efficient on-device matrix assembly, better support for asynchronicity and GPU kernel concurrency, and new communication infrastructure. We evaluate the performance of these developments on some pre-exascale systems as well the early exascale systems Frontier and Aurora, using compute kernel, communication layer, solver, and mini-application benchmark studies, and then close with a few observations drawn from our experiences on the tension between portable performance and other goals of numerical libraries.
format Preprint
id arxiv_https___arxiv_org_abs_2406_08646
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle PETSc/TAO Developments for GPU-Based Early Exascale Systems
Mills, Richard Tran
Adams, Mark
Balay, Satish
Brown, Jed
Faibussowitsch, Jacob
Isaac, Toby
Knepley, Matthew
Munson, Todd
Suh, Hansol
Zampini, Stefano
Zhang, Hong
Zhang, Junchao
Mathematical Software
Distributed, Parallel, and Cluster Computing
00A69
The Portable Extensible Toolkit for Scientific Computation (PETSc) library provides scalable solvers for nonlinear time-dependent differential and algebraic equations and for numerical optimization via the Toolkit for Advanced Optimization (TAO). PETSc is used in dozens of scientific fields and is an important building block for many simulation codes. During the U.S. Department of Energy's Exascale Computing Project, the PETSc team has made substantial efforts to enable efficient utilization of the massive fine-grain parallelism present within exascale compute nodes and to enable performance portability across exascale architectures. We recap some of the challenges that designers of numerical libraries face in such an endeavor, and then discuss the many developments we have made, which include the addition of new GPU backends, features supporting efficient on-device matrix assembly, better support for asynchronicity and GPU kernel concurrency, and new communication infrastructure. We evaluate the performance of these developments on some pre-exascale systems as well the early exascale systems Frontier and Aurora, using compute kernel, communication layer, solver, and mini-application benchmark studies, and then close with a few observations drawn from our experiences on the tension between portable performance and other goals of numerical libraries.
title PETSc/TAO Developments for GPU-Based Early Exascale Systems
topic Mathematical Software
Distributed, Parallel, and Cluster Computing
00A69
url https://arxiv.org/abs/2406.08646