Exascale In-situ visualization for Astronomy & Cosmology

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Tuccari, Nicola, Sciacca, Eva, Becerra, Yolanda, Cintero, Enric Sosa, Tramontana, Emiliano
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914118830653440
author Tuccari, Nicola
Sciacca, Eva
Becerra, Yolanda
Cintero, Enric Sosa
Tramontana, Emiliano
author_facet Tuccari, Nicola
Sciacca, Eva
Becerra, Yolanda
Cintero, Enric Sosa
Tramontana, Emiliano
contents Modern simulations and observations in Astronomy & Cosmology (A&C) produce massively large data volumes, posing significant challenges for storage, access and data analysis. A long-standing bottleneck in high-performance computing, especially now in the exascale era, has been the requirement to write these large datasets to disks, which limits the performance. A promising solution to this challenge is in-situ processing, where analysis and visualization are performed concurrently with the simulation itself, bypassing the storage of the simulation data. In this work, we present new results from an approach for in-situ processing based on Hecuba, a framework that provides a highly distributed database for streaming A&C simulation data directly into the visualization pipeline to make possible on-line visualization. By integrating Hecuba with the high-performance cosmological simulator ChaNGa, we enable real-time, in-situ visualization of N-body simulation results using tools such as ParaView and VisIVO.
format Preprint
id arxiv_https___arxiv_org_abs_2510_24545
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Exascale In-situ visualization for Astronomy & Cosmology
Tuccari, Nicola
Sciacca, Eva
Becerra, Yolanda
Cintero, Enric Sosa
Tramontana, Emiliano
Instrumentation and Methods for Astrophysics
Distributed, Parallel, and Cluster Computing
Modern simulations and observations in Astronomy & Cosmology (A&C) produce massively large data volumes, posing significant challenges for storage, access and data analysis. A long-standing bottleneck in high-performance computing, especially now in the exascale era, has been the requirement to write these large datasets to disks, which limits the performance. A promising solution to this challenge is in-situ processing, where analysis and visualization are performed concurrently with the simulation itself, bypassing the storage of the simulation data. In this work, we present new results from an approach for in-situ processing based on Hecuba, a framework that provides a highly distributed database for streaming A&C simulation data directly into the visualization pipeline to make possible on-line visualization. By integrating Hecuba with the high-performance cosmological simulator ChaNGa, we enable real-time, in-situ visualization of N-body simulation results using tools such as ParaView and VisIVO.
title Exascale In-situ visualization for Astronomy & Cosmology
topic Instrumentation and Methods for Astrophysics
Distributed, Parallel, and Cluster Computing
url https://arxiv.org/abs/2510.24545