Workflow Mini-Apps: Portable, Scalable, Tunable & Faithful Representations of Scientific Workflows
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910385896947712 |
|---|---|
| author | Kilic, Ozgur Ozan Wang, Tianle Turilli, Matteo Titov, Mikhail Merzky, Andre Pouchard, Line Jha, Shantenu |
| author_facet | Kilic, Ozgur Ozan Wang, Tianle Turilli, Matteo Titov, Mikhail Merzky, Andre Pouchard, Line Jha, Shantenu |
| contents | Workflows are critical for scientific discovery. However, the sophistication, heterogeneity, and scale of workflows make building, testing, and optimizing them increasingly challenging. Furthermore, their complexity and heterogeneity make performance reproducibility hard. In this paper, we propose workflow mini-apps as a tool to address the challenges in building and testing workflows while controlling the fidelity of representing realworld workflows. Workflow mini-apps are deployed and run on various HPC systems and architectures without workflow-specific constraints. We offer insight into their design and implementation, providing an analysis of their performance and reproducibility. Workflow mini-apps thus advance the science of workflows by providing simple, portable, and managed (fidelity) representations of otherwise complex and difficult-to-control real workflows. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_18073 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Workflow Mini-Apps: Portable, Scalable, Tunable & Faithful Representations of Scientific Workflows Kilic, Ozgur Ozan Wang, Tianle Turilli, Matteo Titov, Mikhail Merzky, Andre Pouchard, Line Jha, Shantenu Distributed, Parallel, and Cluster Computing Workflows are critical for scientific discovery. However, the sophistication, heterogeneity, and scale of workflows make building, testing, and optimizing them increasingly challenging. Furthermore, their complexity and heterogeneity make performance reproducibility hard. In this paper, we propose workflow mini-apps as a tool to address the challenges in building and testing workflows while controlling the fidelity of representing realworld workflows. Workflow mini-apps are deployed and run on various HPC systems and architectures without workflow-specific constraints. We offer insight into their design and implementation, providing an analysis of their performance and reproducibility. Workflow mini-apps thus advance the science of workflows by providing simple, portable, and managed (fidelity) representations of otherwise complex and difficult-to-control real workflows. |
| title | Workflow Mini-Apps: Portable, Scalable, Tunable & Faithful Representations of Scientific Workflows |
| topic | Distributed, Parallel, and Cluster Computing |
| url | https://arxiv.org/abs/2403.18073 |