Fast Gaussian process inference by exact Matérn kernel decomposition

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Langrené, Nicolas, Warin, Xavier, Gruet, Pierre
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912517328994304
author Langrené, Nicolas
Warin, Xavier
Gruet, Pierre
author_facet Langrené, Nicolas
Warin, Xavier
Gruet, Pierre
contents To speed up Gaussian process inference, a number of fast kernel matrix-vector multiplication (MVM) approximation algorithms have been proposed over the years. In this paper, we establish an exact fast kernel MVM algorithm based on exact kernel decomposition into weighted empirical cumulative distribution functions, compatible with a class of kernels which includes multivariate Matérn kernels with half-integer smoothness parameter. This algorithm uses a divide-and-conquer approach, during which sorting outputs are stored in a data structure. We also propose a new algorithm to take into account some linear fixed effects predictor function. Our numerical experiments confirm that our algorithm is very effective for low-dimensional Gaussian process inference problems with hundreds of thousands of data points. An implementation of our algorithm is available at https://gitlab.com/warin/fastgaussiankernelregression.git.
format Preprint
id arxiv_https___arxiv_org_abs_2508_01864
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Fast Gaussian process inference by exact Matérn kernel decomposition
Langrené, Nicolas
Warin, Xavier
Gruet, Pierre
Machine Learning
Data Structures and Algorithms
Computation
60G15, 65C60, 65F10, 62G30, 62G08, 65F30, 65Y20
G.3; G.1.3; I.2.6; F.2.1
To speed up Gaussian process inference, a number of fast kernel matrix-vector multiplication (MVM) approximation algorithms have been proposed over the years. In this paper, we establish an exact fast kernel MVM algorithm based on exact kernel decomposition into weighted empirical cumulative distribution functions, compatible with a class of kernels which includes multivariate Matérn kernels with half-integer smoothness parameter. This algorithm uses a divide-and-conquer approach, during which sorting outputs are stored in a data structure. We also propose a new algorithm to take into account some linear fixed effects predictor function. Our numerical experiments confirm that our algorithm is very effective for low-dimensional Gaussian process inference problems with hundreds of thousands of data points. An implementation of our algorithm is available at https://gitlab.com/warin/fastgaussiankernelregression.git.
title Fast Gaussian process inference by exact Matérn kernel decomposition
topic Machine Learning
Data Structures and Algorithms
Computation
60G15, 65C60, 65F10, 62G30, 62G08, 65F30, 65Y20
G.3; G.1.3; I.2.6; F.2.1
url https://arxiv.org/abs/2508.01864