Notes on Kernel Methods in Machine Learning
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908662449045504 |
|---|---|
| author | Pérez-Rosero, Diego Armando Salazar-Dubois, Danna Valentina Lugo-Rojas, Juan Camilo Álvarez-Meza, Andrés Marino Castellanos-Dominguez, Germán |
| author_facet | Pérez-Rosero, Diego Armando Salazar-Dubois, Danna Valentina Lugo-Rojas, Juan Camilo Álvarez-Meza, Andrés Marino Castellanos-Dominguez, Germán |
| contents | These notes provide a self-contained introduction to kernel methods and their geometric foundations in machine learning. Starting from the construction of Hilbert spaces, we develop the theory of positive definite kernels, reproducing kernel Hilbert spaces (RKHS), and Hilbert-Schmidt operators, emphasizing their role in statistical estimation and representation of probability measures. Classical concepts such as covariance, regression, and information measures are revisited through the lens of Hilbert space geometry. We also introduce kernel density estimation, kernel embeddings of distributions, and the Maximum Mean Discrepancy (MMD). The exposition is designed to serve as a foundation for more advanced topics, including Gaussian processes, kernel Bayesian inference, and functional analytic approaches to modern machine learning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_14485 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Notes on Kernel Methods in Machine Learning Pérez-Rosero, Diego Armando Salazar-Dubois, Danna Valentina Lugo-Rojas, Juan Camilo Álvarez-Meza, Andrés Marino Castellanos-Dominguez, Germán Machine Learning These notes provide a self-contained introduction to kernel methods and their geometric foundations in machine learning. Starting from the construction of Hilbert spaces, we develop the theory of positive definite kernels, reproducing kernel Hilbert spaces (RKHS), and Hilbert-Schmidt operators, emphasizing their role in statistical estimation and representation of probability measures. Classical concepts such as covariance, regression, and information measures are revisited through the lens of Hilbert space geometry. We also introduce kernel density estimation, kernel embeddings of distributions, and the Maximum Mean Discrepancy (MMD). The exposition is designed to serve as a foundation for more advanced topics, including Gaussian processes, kernel Bayesian inference, and functional analytic approaches to modern machine learning. |
| title | Notes on Kernel Methods in Machine Learning |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2511.14485 |