Predictive posterior sampling from non-stationnary Gaussian process priors via Diffusion models with application to climate data

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Cardoso, Gabriel V, Pereira, Mike
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908386077966336
author Cardoso, Gabriel V
Pereira, Mike
author_facet Cardoso, Gabriel V
Pereira, Mike
contents Bayesian models based on Gaussian processes (GPs) offer a flexible framework to predict spatially distributed variables with uncertainty. But the use of nonstationary priors, often necessary for capturing complex spatial patterns, makes sampling from the predictive posterior distribution (PPD) computationally intractable. In this paper, we propose a two-step approach based on diffusion generative models (DGMs) to mimic PPDs associated with non-stationary GP priors: we replace the GP prior by a DGM surrogate, and leverage recent advances on training-free guidance algorithms for DGMs to sample from the desired posterior distribution. We apply our approach to a rich non-stationary GP prior from which exact posterior sampling is untractable and validate that the issuing distributions are close to their GP counterpart using several statistical metrics. We also demonstrate how one can fine-tune the trained DGMs to target specific parts of the GP prior. Finally we apply the proposed approach to solve inverse problems arising in environmental sciences, thus yielding state-of-the-art predictions.
format Preprint
id arxiv_https___arxiv_org_abs_2505_24556
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Predictive posterior sampling from non-stationnary Gaussian process priors via Diffusion models with application to climate data
Cardoso, Gabriel V
Pereira, Mike
Machine Learning
Bayesian models based on Gaussian processes (GPs) offer a flexible framework to predict spatially distributed variables with uncertainty. But the use of nonstationary priors, often necessary for capturing complex spatial patterns, makes sampling from the predictive posterior distribution (PPD) computationally intractable. In this paper, we propose a two-step approach based on diffusion generative models (DGMs) to mimic PPDs associated with non-stationary GP priors: we replace the GP prior by a DGM surrogate, and leverage recent advances on training-free guidance algorithms for DGMs to sample from the desired posterior distribution. We apply our approach to a rich non-stationary GP prior from which exact posterior sampling is untractable and validate that the issuing distributions are close to their GP counterpart using several statistical metrics. We also demonstrate how one can fine-tune the trained DGMs to target specific parts of the GP prior. Finally we apply the proposed approach to solve inverse problems arising in environmental sciences, thus yielding state-of-the-art predictions.
title Predictive posterior sampling from non-stationnary Gaussian process priors via Diffusion models with application to climate data
topic Machine Learning
url https://arxiv.org/abs/2505.24556