Large Data Acquisition and Analytics at Synchrotron Radiation Facilities

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Panta, Aashish, Scorzelli, Giorgio, Gooch, Amy A., Sun, Werner, Shanks, Katherine S., Sarker, Suchismita, Bougie, Devin, Soloway, Keara, Verberg, Rolf, Berman, Tracy, Tarcea, Glenn, Allison, John, Taufer, Michela, Pascucci, Valerio
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866917251415801856
author Panta, Aashish
Scorzelli, Giorgio
Gooch, Amy A.
Sun, Werner
Shanks, Katherine S.
Sarker, Suchismita
Bougie, Devin
Soloway, Keara
Verberg, Rolf
Berman, Tracy
Tarcea, Glenn
Allison, John
Taufer, Michela
Pascucci, Valerio
author_facet Panta, Aashish
Scorzelli, Giorgio
Gooch, Amy A.
Sun, Werner
Shanks, Katherine S.
Sarker, Suchismita
Bougie, Devin
Soloway, Keara
Verberg, Rolf
Berman, Tracy
Tarcea, Glenn
Allison, John
Taufer, Michela
Pascucci, Valerio
contents Synchrotron facilities like the Cornell High Energy Synchrotron Source (CHESS) generate massive data volumes from complex beamline experiments, but face challenges such as limited access time, the need for on-site experiment monitoring, and managing terabytes of data per user group. We present the design, deployment, and evaluation of a framework that addresses CHESS's data acquisition and management issues. Deployed on a secure CHESS server, our system provides real time, web-based tools for remote experiment monitoring and data quality assessment, improving operational efficiency. Implemented across three beamlines (ID3A, ID3B, ID4B), the framework managed 50-100 TB of data and over 10 million files in late 2024. Testing with 43 research groups and 86 dashboards showed reduced overhead, improved accessibility, and streamlined data workflows. Our paper highlights the development, deployment, and evaluation of our framework and its transformative impact on synchrotron data acquisition.
format Preprint
id arxiv_https___arxiv_org_abs_2602_05837
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Large Data Acquisition and Analytics at Synchrotron Radiation Facilities
Panta, Aashish
Scorzelli, Giorgio
Gooch, Amy A.
Sun, Werner
Shanks, Katherine S.
Sarker, Suchismita
Bougie, Devin
Soloway, Keara
Verberg, Rolf
Berman, Tracy
Tarcea, Glenn
Allison, John
Taufer, Michela
Pascucci, Valerio
Human-Computer Interaction
Synchrotron facilities like the Cornell High Energy Synchrotron Source (CHESS) generate massive data volumes from complex beamline experiments, but face challenges such as limited access time, the need for on-site experiment monitoring, and managing terabytes of data per user group. We present the design, deployment, and evaluation of a framework that addresses CHESS's data acquisition and management issues. Deployed on a secure CHESS server, our system provides real time, web-based tools for remote experiment monitoring and data quality assessment, improving operational efficiency. Implemented across three beamlines (ID3A, ID3B, ID4B), the framework managed 50-100 TB of data and over 10 million files in late 2024. Testing with 43 research groups and 86 dashboards showed reduced overhead, improved accessibility, and streamlined data workflows. Our paper highlights the development, deployment, and evaluation of our framework and its transformative impact on synchrotron data acquisition.
title Large Data Acquisition and Analytics at Synchrotron Radiation Facilities
topic Human-Computer Interaction
url https://arxiv.org/abs/2602.05837