Computationally efficient multi-level Gaussian process regression for functional data observed under completely or partially regular sampling designs

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Hoffmann, Adam Gorm, Ekstrøm, Claus Thorn, Jensen, Andreas Kryger
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912952429314048
author Hoffmann, Adam Gorm
Ekstrøm, Claus Thorn
Jensen, Andreas Kryger
author_facet Hoffmann, Adam Gorm
Ekstrøm, Claus Thorn
Jensen, Andreas Kryger
contents Gaussian process regression is a frequently used statistical method for flexible yet fully probabilistic non-linear regression modeling. A common obstacle is its computational complexity which scales poorly with the number of observations. This is especially an issue when applying Gaussian process models to multiple functions simultaneously in various applications of functional data analysis. We consider a multi-level Gaussian process regression model where a common mean function and individual subject-specific deviations are modeled simultaneously as latent Gaussian processes. We derive exact analytic and computationally efficient expressions for the log-likelihood function and the posterior distributions in the case where the observations are sampled on either a completely or partially regular grid. This enables us to fit the model to large data sets that are currently computationally inaccessible using a standard implementation. We show through a simulation study that our analytic expressions are several orders of magnitude faster compared to a standard implementation, and we provide an implementation in the probabilistic programming language Stan.
format Preprint
id arxiv_https___arxiv_org_abs_2406_13691
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Computationally efficient multi-level Gaussian process regression for functional data observed under completely or partially regular sampling designs
Hoffmann, Adam Gorm
Ekstrøm, Claus Thorn
Jensen, Andreas Kryger
Methodology
Computation
62F15, 60G15, 62G08
G.3
Gaussian process regression is a frequently used statistical method for flexible yet fully probabilistic non-linear regression modeling. A common obstacle is its computational complexity which scales poorly with the number of observations. This is especially an issue when applying Gaussian process models to multiple functions simultaneously in various applications of functional data analysis. We consider a multi-level Gaussian process regression model where a common mean function and individual subject-specific deviations are modeled simultaneously as latent Gaussian processes. We derive exact analytic and computationally efficient expressions for the log-likelihood function and the posterior distributions in the case where the observations are sampled on either a completely or partially regular grid. This enables us to fit the model to large data sets that are currently computationally inaccessible using a standard implementation. We show through a simulation study that our analytic expressions are several orders of magnitude faster compared to a standard implementation, and we provide an implementation in the probabilistic programming language Stan.
title Computationally efficient multi-level Gaussian process regression for functional data observed under completely or partially regular sampling designs
topic Methodology
Computation
62F15, 60G15, 62G08
G.3
url https://arxiv.org/abs/2406.13691