Scalable ATLAS pMSSM computational workflows using containerised REANA reusable analysis platform
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866914705072717824 |
|---|---|
| author | Donadoni, Marco Feickert, Matthew Heinrich, Lukas Liu, Yang Mečionis, Audrius Moisieienkov, Vladyslav Šimko, Tibor Stark, Giordon García, Marco Vidal |
| author_facet | Donadoni, Marco Feickert, Matthew Heinrich, Lukas Liu, Yang Mečionis, Audrius Moisieienkov, Vladyslav Šimko, Tibor Stark, Giordon García, Marco Vidal |
| contents | In this paper we describe the development of a streamlined framework for large-scale ATLAS pMSSM reinterpretations of LHC Run-2 analyses using containerised computational workflows. The project is looking to assess the global coverage of BSM physics and requires running O(5k) computational workflows representing pMSSM model points. Following ATLAS Analysis Preservation policies, many analyses have been preserved as containerised Yadage workflows, and after validation were added to a curated selection for the pMSSM study. To run the workflows at scale, we utilised the REANA reusable analysis platform. We describe how the REANA platform was enhanced to ensure the best concurrent throughput by internal service scheduling changes. We discuss the scalability of the approach on Kubernetes clusters from 500 to 5000 cores. Finally, we demonstrate a possibility of using additional ad-hoc public cloud infrastructure resources by running the same workflows on the Google Cloud Platform. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_03494 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Scalable ATLAS pMSSM computational workflows using containerised REANA reusable analysis platform Donadoni, Marco Feickert, Matthew Heinrich, Lukas Liu, Yang Mečionis, Audrius Moisieienkov, Vladyslav Šimko, Tibor Stark, Giordon García, Marco Vidal Distributed, Parallel, and Cluster Computing High Energy Physics - Experiment In this paper we describe the development of a streamlined framework for large-scale ATLAS pMSSM reinterpretations of LHC Run-2 analyses using containerised computational workflows. The project is looking to assess the global coverage of BSM physics and requires running O(5k) computational workflows representing pMSSM model points. Following ATLAS Analysis Preservation policies, many analyses have been preserved as containerised Yadage workflows, and after validation were added to a curated selection for the pMSSM study. To run the workflows at scale, we utilised the REANA reusable analysis platform. We describe how the REANA platform was enhanced to ensure the best concurrent throughput by internal service scheduling changes. We discuss the scalability of the approach on Kubernetes clusters from 500 to 5000 cores. Finally, we demonstrate a possibility of using additional ad-hoc public cloud infrastructure resources by running the same workflows on the Google Cloud Platform. |
| title | Scalable ATLAS pMSSM computational workflows using containerised REANA reusable analysis platform |
| topic | Distributed, Parallel, and Cluster Computing High Energy Physics - Experiment |
| url | https://arxiv.org/abs/2403.03494 |