Sparse flow reconstruction methods to reduce the costs of analyzing large unsteady datasets

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Stahl, Spencer L., Benton, Stuart I.
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909352024080384
author Stahl, Spencer L.
Benton, Stuart I.
author_facet Stahl, Spencer L.
Benton, Stuart I.
contents The cost of writing, transferring, and storing large data from unsteady simulations limits access to the entire solution, often leaving much of the flow under-sampled or unanalyzed. For example, modeling transient behavior of rare dynamic events requires 3D snapshots at high sampling rates over long periods, generating significant amounts of data and creating challenges for practical CFD workflows, especially with limited memory resources and costly GPU writing penalties. In this work, multiple sparse flow reconstruction (SFR) methods are developed to approximate a full unsteady solution using far fewer sparse measurements, thus reducing writing costs, data storage, and enabling higher sampling rates. SFR is motivated by a large-eddy simulation of rare inlet distortion events, demonstrating that down-sampling full snapshots and supplementing them with high-frequency sparse measurements can drastically cut writing time for GPU solvers and nearly eliminate this cost for CPU solvers. The simplest single-equation "snapshot" SFR method can be compressed further using Proper Orthogonal Decomposition (POD-SFR) or a more efficient double POD-SFR variant. A streaming SFR modification improves reconstruction efficiency when local memory is limited. A sensitivity study evaluates trade-offs between sparse sampling rates and reconstruction accuracy, offering best practices. To offset error of using random sparse measurements, SFR exactly preserves dynamics in key regions by prescribing sparse measurement locations, used here to capture distortion events. Distortion events are evaluated using the conditional space-time proper orthogonal decomposition (CST-POD) to pursue physical insights that characterize the upstream causality at full resolution. A validation study of CST-POD modes confirms SFR effectiveness at retaining the event dynamics with substantial computational and memory savings.
format Preprint
id arxiv_https___arxiv_org_abs_2410_12627
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Sparse flow reconstruction methods to reduce the costs of analyzing large unsteady datasets
Stahl, Spencer L.
Benton, Stuart I.
Data Analysis, Statistics and Probability
The cost of writing, transferring, and storing large data from unsteady simulations limits access to the entire solution, often leaving much of the flow under-sampled or unanalyzed. For example, modeling transient behavior of rare dynamic events requires 3D snapshots at high sampling rates over long periods, generating significant amounts of data and creating challenges for practical CFD workflows, especially with limited memory resources and costly GPU writing penalties. In this work, multiple sparse flow reconstruction (SFR) methods are developed to approximate a full unsteady solution using far fewer sparse measurements, thus reducing writing costs, data storage, and enabling higher sampling rates. SFR is motivated by a large-eddy simulation of rare inlet distortion events, demonstrating that down-sampling full snapshots and supplementing them with high-frequency sparse measurements can drastically cut writing time for GPU solvers and nearly eliminate this cost for CPU solvers. The simplest single-equation "snapshot" SFR method can be compressed further using Proper Orthogonal Decomposition (POD-SFR) or a more efficient double POD-SFR variant. A streaming SFR modification improves reconstruction efficiency when local memory is limited. A sensitivity study evaluates trade-offs between sparse sampling rates and reconstruction accuracy, offering best practices. To offset error of using random sparse measurements, SFR exactly preserves dynamics in key regions by prescribing sparse measurement locations, used here to capture distortion events. Distortion events are evaluated using the conditional space-time proper orthogonal decomposition (CST-POD) to pursue physical insights that characterize the upstream causality at full resolution. A validation study of CST-POD modes confirms SFR effectiveness at retaining the event dynamics with substantial computational and memory savings.
title Sparse flow reconstruction methods to reduce the costs of analyzing large unsteady datasets
topic Data Analysis, Statistics and Probability
url https://arxiv.org/abs/2410.12627