AI-coupled HPC Workflow Applications, Middleware and Performance
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866912448050626560 |
|---|---|
| author | Brewer, Wes Gainaru, Ana Suter, Frédéric Wang, Feiyi Emani, Murali Jha, Shantenu |
| author_facet | Brewer, Wes Gainaru, Ana Suter, Frédéric Wang, Feiyi Emani, Murali Jha, Shantenu |
| contents | AI integration is revolutionizing the landscape of HPC simulations, enhancing the importance, use, and performance of AI-driven HPC workflows. This paper surveys the diverse and rapidly evolving field of AI-driven HPC and provides a common conceptual basis for understanding AI-driven HPC workflows. Specifically, we use insights from different modes of coupling AI into HPC workflows to propose six execution motifs most commonly found in scientific applications. The proposed set of execution motifs is by definition incomplete and evolving. However, they allow us to analyze the primary performance challenges underpinning AI-driven HPC workflows. We close with a listing of open challenges, research issues, and suggested areas of investigation including the the need for specific benchmarks that will help evaluate and improve the execution of AI-driven HPC workflows. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_14315 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | AI-coupled HPC Workflow Applications, Middleware and Performance Brewer, Wes Gainaru, Ana Suter, Frédéric Wang, Feiyi Emani, Murali Jha, Shantenu Distributed, Parallel, and Cluster Computing AI integration is revolutionizing the landscape of HPC simulations, enhancing the importance, use, and performance of AI-driven HPC workflows. This paper surveys the diverse and rapidly evolving field of AI-driven HPC and provides a common conceptual basis for understanding AI-driven HPC workflows. Specifically, we use insights from different modes of coupling AI into HPC workflows to propose six execution motifs most commonly found in scientific applications. The proposed set of execution motifs is by definition incomplete and evolving. However, they allow us to analyze the primary performance challenges underpinning AI-driven HPC workflows. We close with a listing of open challenges, research issues, and suggested areas of investigation including the the need for specific benchmarks that will help evaluate and improve the execution of AI-driven HPC workflows. |
| title | AI-coupled HPC Workflow Applications, Middleware and Performance |
| topic | Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2406.14315 |