Parallelized Event Data Management System Based on MT-SNiPER Framework and PODIO
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909457648189440 |
|---|---|
| author | Shi, Qianqian Li, Teng Huang, Xingtao |
| author_facet | Shi, Qianqian Li, Teng Huang, Xingtao |
| contents | Software framework serves as a skeleton for the offline data processing software for many high energy physics (HEP) experiments. The event data management, including the event data model (EDM), transient event store and data input/output, implements the core functionalities of the framework, and has a great impact on the performance of the entire offline software. Future HEP experiments are generating increasingly large amounts of data, bringing challenges to offline data processing. To address this issue, a common event data management system that supports efficient parallelized data processing applications has been developed based on SNiPER (Software for Non-collider Physics ExpeRiments) common software framework as well as PODIO, a common EDM toolkit for future HEP experiments. In this paper, the implementation of a parallelized event data management (PEDM) system is introduced, including the integration with MT-SNiPER and PODIO, as well as the implementation of GlobalStore to support multi-threaded event processing. Finally, the application and performance evaluation of the data management system in OSCAR (offline software of Super Tau Charm Facility) is presented. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_09271 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Parallelized Event Data Management System Based on MT-SNiPER Framework and PODIO Shi, Qianqian Li, Teng Huang, Xingtao High Energy Physics - Experiment Software framework serves as a skeleton for the offline data processing software for many high energy physics (HEP) experiments. The event data management, including the event data model (EDM), transient event store and data input/output, implements the core functionalities of the framework, and has a great impact on the performance of the entire offline software. Future HEP experiments are generating increasingly large amounts of data, bringing challenges to offline data processing. To address this issue, a common event data management system that supports efficient parallelized data processing applications has been developed based on SNiPER (Software for Non-collider Physics ExpeRiments) common software framework as well as PODIO, a common EDM toolkit for future HEP experiments. In this paper, the implementation of a parallelized event data management (PEDM) system is introduced, including the integration with MT-SNiPER and PODIO, as well as the implementation of GlobalStore to support multi-threaded event processing. Finally, the application and performance evaluation of the data management system in OSCAR (offline software of Super Tau Charm Facility) is presented. |
| title | Parallelized Event Data Management System Based on MT-SNiPER Framework and PODIO |
| topic | High Energy Physics - Experiment |
| url | https://arxiv.org/abs/2501.09271 |