Scalable Gaussian Process Inference with Stan

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Hoffmann, Till, Onnela, Jukka-Pekka
Formato: Preprint
Publicado: 2023
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914636231606272
author Hoffmann, Till
Onnela, Jukka-Pekka
author_facet Hoffmann, Till
Onnela, Jukka-Pekka
contents Gaussian processes (GPs) are sophisticated distributions to model functional data. Whilst theoretically appealing, they are computationally cumbersome except for small datasets. We implement two methods for scaling GP inference in Stan: First, a general sparse approximation using a directed acyclic dependency graph; second, a fast, exact method for regularly spaced data modeled by GPs with stationary kernels using the fast Fourier transform. Based on benchmark experiments, we offer guidance for practitioners to decide between different methods and parameterizations. We consider two real-world examples to illustrate the package. The implementation follows Stan's design and exposes performant inference through a familiar interface. Full posterior inference for ten thousand data points is feasible on a laptop in less than 20 seconds. Details on how to get started using the popular interfaces cmdstanpy for Python and cmdstanr for R are provided.
format Preprint
id arxiv_https___arxiv_org_abs_2301_08836
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Scalable Gaussian Process Inference with Stan
Hoffmann, Till
Onnela, Jukka-Pekka
Methodology
Computation
Gaussian processes (GPs) are sophisticated distributions to model functional data. Whilst theoretically appealing, they are computationally cumbersome except for small datasets. We implement two methods for scaling GP inference in Stan: First, a general sparse approximation using a directed acyclic dependency graph; second, a fast, exact method for regularly spaced data modeled by GPs with stationary kernels using the fast Fourier transform. Based on benchmark experiments, we offer guidance for practitioners to decide between different methods and parameterizations. We consider two real-world examples to illustrate the package. The implementation follows Stan's design and exposes performant inference through a familiar interface. Full posterior inference for ten thousand data points is feasible on a laptop in less than 20 seconds. Details on how to get started using the popular interfaces cmdstanpy for Python and cmdstanr for R are provided.
title Scalable Gaussian Process Inference with Stan
topic Methodology
Computation
url https://arxiv.org/abs/2301.08836