Saved in:
Bibliographic Details
Main Authors: Warner, James E., Shah, Tristan A., Leser, Patrick E., Bomarito, Geoffrey F., Pribe, Joshua D., Stanley, Michael C.
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2505.13007
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913078358048768
author Warner, James E.
Shah, Tristan A.
Leser, Patrick E.
Bomarito, Geoffrey F.
Pribe, Joshua D.
Stanley, Michael C.
author_facet Warner, James E.
Shah, Tristan A.
Leser, Patrick E.
Bomarito, Geoffrey F.
Pribe, Joshua D.
Stanley, Michael C.
contents The ability to accurately model random fields plays a critical role in science and engineering for problems involving uncertain, spatially-varying quantities such as heterogeneous material properties and turbulent flows. Deep generative models offer a powerful tool for sampling high- or infinite-dimensional uncertainties like random fields, but their reliance on large, dense training datasets limits their applicability in contexts where sufficient data is difficult or expensive to obtain. In this work, we propose a latent-space approach to generative modeling of random fields that incorporates domain knowledge to supplement limited training data. A constraint-aware variational autoencoder (VAE) with a function decoder is first used to learn compact latent representations of continuous functions that adhere to known physical or statistical constraints, even when training data is sparse or indirect. Generative modeling is then performed in the learned latent space, decoupling constraint enforcement from the sampling process. This decoupling enables expressive multi-step generative methods to be deployed in data-limited settings where existing constrained multi-step approaches are not directly applicable. The richer latent distributions captured by the generative model also overcome limitations of standard VAEs, which rely on simple parametric priors and struggle to represent complex, multimodal, or heavy-tailed distributions over functions. Efficacy is demonstrated on two challenging applications: wind velocity field reconstruction from sparse sensors and material property inference from indirect measurements. Results show the effectiveness of incorporating domain knowledge constraints for data-limited problems and the improved sample quality and robustness of the latent generative modeling approach versus directly sampling a constrained VAE.
format Preprint
id arxiv_https___arxiv_org_abs_2505_13007
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Latent Generative Modeling of Random Fields from Limited Training Data
Warner, James E.
Shah, Tristan A.
Leser, Patrick E.
Bomarito, Geoffrey F.
Pribe, Joshua D.
Stanley, Michael C.
Machine Learning
Computational Engineering, Finance, and Science
The ability to accurately model random fields plays a critical role in science and engineering for problems involving uncertain, spatially-varying quantities such as heterogeneous material properties and turbulent flows. Deep generative models offer a powerful tool for sampling high- or infinite-dimensional uncertainties like random fields, but their reliance on large, dense training datasets limits their applicability in contexts where sufficient data is difficult or expensive to obtain. In this work, we propose a latent-space approach to generative modeling of random fields that incorporates domain knowledge to supplement limited training data. A constraint-aware variational autoencoder (VAE) with a function decoder is first used to learn compact latent representations of continuous functions that adhere to known physical or statistical constraints, even when training data is sparse or indirect. Generative modeling is then performed in the learned latent space, decoupling constraint enforcement from the sampling process. This decoupling enables expressive multi-step generative methods to be deployed in data-limited settings where existing constrained multi-step approaches are not directly applicable. The richer latent distributions captured by the generative model also overcome limitations of standard VAEs, which rely on simple parametric priors and struggle to represent complex, multimodal, or heavy-tailed distributions over functions. Efficacy is demonstrated on two challenging applications: wind velocity field reconstruction from sparse sensors and material property inference from indirect measurements. Results show the effectiveness of incorporating domain knowledge constraints for data-limited problems and the improved sample quality and robustness of the latent generative modeling approach versus directly sampling a constrained VAE.
title Latent Generative Modeling of Random Fields from Limited Training Data
topic Machine Learning
Computational Engineering, Finance, and Science
url https://arxiv.org/abs/2505.13007