Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2403.09215 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914714636779520 |
|---|---|
| author | Besginow, Andreas Hüwel, Jan David Pawellek, Thomas Beecks, Christian Lange-Hegermann, Markus |
| author_facet | Besginow, Andreas Hüwel, Jan David Pawellek, Thomas Beecks, Christian Lange-Hegermann, Markus |
| contents | Model selection aims to find the best model in terms of accuracy, interpretability or simplicity, preferably all at once. In this work, we focus on evaluating model performance of Gaussian process models, i.e. finding a metric that provides the best trade-off between all those criteria. While previous work considers metrics like the likelihood, AIC or dynamic nested sampling, they either lack performance or have significant runtime issues, which severely limits applicability. We address these challenges by introducing multiple metrics based on the Laplace approximation, where we overcome a severe inconsistency occuring during naive application of the Laplace approximation. Experiments show that our metrics are comparable in quality to the gold standard dynamic nested sampling without compromising for computational speed. Our model selection criteria allow significantly faster and high quality model selection of Gaussian process models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_09215 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | On the Laplace Approximation as Model Selection Criterion for Gaussian Processes Besginow, Andreas Hüwel, Jan David Pawellek, Thomas Beecks, Christian Lange-Hegermann, Markus Machine Learning Artificial Intelligence Model selection aims to find the best model in terms of accuracy, interpretability or simplicity, preferably all at once. In this work, we focus on evaluating model performance of Gaussian process models, i.e. finding a metric that provides the best trade-off between all those criteria. While previous work considers metrics like the likelihood, AIC or dynamic nested sampling, they either lack performance or have significant runtime issues, which severely limits applicability. We address these challenges by introducing multiple metrics based on the Laplace approximation, where we overcome a severe inconsistency occuring during naive application of the Laplace approximation. Experiments show that our metrics are comparable in quality to the gold standard dynamic nested sampling without compromising for computational speed. Our model selection criteria allow significantly faster and high quality model selection of Gaussian process models. |
| title | On the Laplace Approximation as Model Selection Criterion for Gaussian Processes |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2403.09215 |