Multi-View Oriented GPLVM: Expressiveness and Efficiency

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Yang, Zi, Li, Ying, Lin, Zhidi, Zhang, Michael Minyi, Olmos, Pablo M.
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909961205841920
author Yang, Zi
Li, Ying
Lin, Zhidi
Zhang, Michael Minyi
Olmos, Pablo M.
author_facet Yang, Zi
Li, Ying
Lin, Zhidi
Zhang, Michael Minyi
Olmos, Pablo M.
contents The multi-view Gaussian process latent variable model (MV-GPLVM) aims to learn a unified representation from multi-view data but is hindered by challenges such as limited kernel expressiveness and low computational efficiency. To overcome these issues, we first introduce a new duality between the spectral density and the kernel function. By modeling the spectral density with a bivariate Gaussian mixture, we then derive a generic and expressive kernel termed Next-Gen Spectral Mixture (NG-SM) for MV-GPLVMs. To address the inherent computational inefficiency of the NG-SM kernel, we design a new form of random Fourier feature approximation. Combined with a tailored reparameterization trick, this approximation enables scalable variational inference for both the model and the unified latent representations. Numerical evaluations across a diverse range of multi-view datasets demonstrate that our proposed method consistently outperforms state-of-the-art models in learning meaningful latent representations.
format Preprint
id arxiv_https___arxiv_org_abs_2502_08253
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Multi-View Oriented GPLVM: Expressiveness and Efficiency
Yang, Zi
Li, Ying
Lin, Zhidi
Zhang, Michael Minyi
Olmos, Pablo M.
Machine Learning
The multi-view Gaussian process latent variable model (MV-GPLVM) aims to learn a unified representation from multi-view data but is hindered by challenges such as limited kernel expressiveness and low computational efficiency. To overcome these issues, we first introduce a new duality between the spectral density and the kernel function. By modeling the spectral density with a bivariate Gaussian mixture, we then derive a generic and expressive kernel termed Next-Gen Spectral Mixture (NG-SM) for MV-GPLVMs. To address the inherent computational inefficiency of the NG-SM kernel, we design a new form of random Fourier feature approximation. Combined with a tailored reparameterization trick, this approximation enables scalable variational inference for both the model and the unified latent representations. Numerical evaluations across a diverse range of multi-view datasets demonstrate that our proposed method consistently outperforms state-of-the-art models in learning meaningful latent representations.
title Multi-View Oriented GPLVM: Expressiveness and Efficiency
topic Machine Learning
url https://arxiv.org/abs/2502.08253