Scalable Gaussian process inference via neural feature maps

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
1. Verfasser: Stephenson, Anthony
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913111247683584
author Stephenson, Anthony
author_facet Stephenson, Anthony
contents We present a theoretically grounded Gaussian process framework that leverages neural feature maps to construct expressive kernels. We show that the learned feature map can be interpreted as an optimal low-rank approximation to a Gram matrix derived from an implied RKHS, from which we establish consistency of the GP posterior. We further analyse the spectral properties of the induced kernels and introduce product feature-map kernels to address oversmoothing. This simple yet powerful approach enables fast, scalable, and accurate exact GP inference with minimal upfront work. The flexibility of kernel design supports seamless application to both regression and classification tasks across diverse data modalities, including tabular inputs and structured domains such as images. On benchmark datasets, this approach surpasses pre-existing methods in terms of accuracy and training and prediction efficiency.
format Preprint
id arxiv_https___arxiv_org_abs_2605_10285
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Scalable Gaussian process inference via neural feature maps
Stephenson, Anthony
Machine Learning
60G15, 62G08
G.3
We present a theoretically grounded Gaussian process framework that leverages neural feature maps to construct expressive kernels. We show that the learned feature map can be interpreted as an optimal low-rank approximation to a Gram matrix derived from an implied RKHS, from which we establish consistency of the GP posterior. We further analyse the spectral properties of the induced kernels and introduce product feature-map kernels to address oversmoothing. This simple yet powerful approach enables fast, scalable, and accurate exact GP inference with minimal upfront work. The flexibility of kernel design supports seamless application to both regression and classification tasks across diverse data modalities, including tabular inputs and structured domains such as images. On benchmark datasets, this approach surpasses pre-existing methods in terms of accuracy and training and prediction efficiency.
title Scalable Gaussian process inference via neural feature maps
topic Machine Learning
60G15, 62G08
G.3
url https://arxiv.org/abs/2605.10285