Improving Iterative Gaussian Processes via Warm Starting Sequential Posteriors
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866908667114160128 |
|---|---|
| author | Dong, Alan Yufei Lin, Jihao Andreas Hernández-Lobato, José Miguel |
| author_facet | Dong, Alan Yufei Lin, Jihao Andreas Hernández-Lobato, José Miguel |
| contents | Scalable Gaussian process (GP) inference is essential for sequential decision-making tasks, yet improving GP scalability remains a challenging problem with many open avenues of research. This paper focuses on iterative GPs, where iterative linear solvers, such as conjugate gradients, stochastic gradient descent or alternative projections, are used to approximate the GP posterior. We propose a new method which improves solver convergence of a large linear system by leveraging the known solution to a smaller system contained within. This is significant for tasks with incremental data additions, and we show that our technique achieves speed-ups when solving to tolerance, as well as improved Bayesian optimisation performance under a fixed compute budget. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_16340 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Improving Iterative Gaussian Processes via Warm Starting Sequential Posteriors Dong, Alan Yufei Lin, Jihao Andreas Hernández-Lobato, José Miguel Machine Learning Scalable Gaussian process (GP) inference is essential for sequential decision-making tasks, yet improving GP scalability remains a challenging problem with many open avenues of research. This paper focuses on iterative GPs, where iterative linear solvers, such as conjugate gradients, stochastic gradient descent or alternative projections, are used to approximate the GP posterior. We propose a new method which improves solver convergence of a large linear system by leveraging the known solution to a smaller system contained within. This is significant for tasks with incremental data additions, and we show that our technique achieves speed-ups when solving to tolerance, as well as improved Bayesian optimisation performance under a fixed compute budget. |
| title | Improving Iterative Gaussian Processes via Warm Starting Sequential Posteriors |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2511.16340 |