Kernel manifolds: nonlinear-augmentation dimensionality reduction using reproducing kernel Hilbert spaces

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Diaz, Alejandro N., Needels, Jacob T., Tezaur, Irina K., Blonigan, Patrick J.
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866918132927430656
author Diaz, Alejandro N.
Needels, Jacob T.
Tezaur, Irina K.
Blonigan, Patrick J.
author_facet Diaz, Alejandro N.
Needels, Jacob T.
Tezaur, Irina K.
Blonigan, Patrick J.
contents This paper generalizes recent advances on quadratic manifold (QM) dimensionality reduction by developing kernel methods-based nonlinear-augmentation dimensionality reduction. QMs, and more generally feature map-based nonlinear corrections, augment linear dimensionality reduction with a nonlinear correction term in the reconstruction map to overcome approximation accuracy limitations of purely linear approaches. While feature map-based approaches typically learn a least-squares optimal polynomial correction term, we generalize this approach by learning an optimal nonlinear correction from a user-defined reproducing kernel Hilbert space. Our approach allows one to impose arbitrary nonlinear structure on the correction term, including polynomial structure, and includes feature map and radial basis function-based corrections as special cases. Furthermore, our method has relatively low training cost and has monotonically decreasing error as the latent space dimension increases. We compare our approach to proper orthogonal decomposition and several recent QM approaches on data from several example problems.
format Preprint
id arxiv_https___arxiv_org_abs_2509_00224
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Kernel manifolds: nonlinear-augmentation dimensionality reduction using reproducing kernel Hilbert spaces
Diaz, Alejandro N.
Needels, Jacob T.
Tezaur, Irina K.
Blonigan, Patrick J.
Computational Engineering, Finance, and Science
Numerical Analysis
This paper generalizes recent advances on quadratic manifold (QM) dimensionality reduction by developing kernel methods-based nonlinear-augmentation dimensionality reduction. QMs, and more generally feature map-based nonlinear corrections, augment linear dimensionality reduction with a nonlinear correction term in the reconstruction map to overcome approximation accuracy limitations of purely linear approaches. While feature map-based approaches typically learn a least-squares optimal polynomial correction term, we generalize this approach by learning an optimal nonlinear correction from a user-defined reproducing kernel Hilbert space. Our approach allows one to impose arbitrary nonlinear structure on the correction term, including polynomial structure, and includes feature map and radial basis function-based corrections as special cases. Furthermore, our method has relatively low training cost and has monotonically decreasing error as the latent space dimension increases. We compare our approach to proper orthogonal decomposition and several recent QM approaches on data from several example problems.
title Kernel manifolds: nonlinear-augmentation dimensionality reduction using reproducing kernel Hilbert spaces
topic Computational Engineering, Finance, and Science
Numerical Analysis
url https://arxiv.org/abs/2509.00224