On Probabilistic Pullback Metrics for Latent Hyperbolic Manifolds

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Augenstein, Luis, Jaquier, Noémie, Asfour, Tamim, Rozo, Leonel
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916740950130688
author Augenstein, Luis
Jaquier, Noémie
Asfour, Tamim
Rozo, Leonel
author_facet Augenstein, Luis
Jaquier, Noémie
Asfour, Tamim
Rozo, Leonel
contents Probabilistic Latent Variable Models (LVMs) excel at modeling complex, high-dimensional data through lower-dimensional representations. Recent advances show that equipping these latent representations with a Riemannian metric unlocks geometry-aware distances and shortest paths that comply with the underlying data structure. This paper focuses on hyperbolic embeddings, a particularly suitable choice for modeling hierarchical relationships. Previous approaches relying on hyperbolic geodesics for interpolating the latent space often generate paths crossing low-data regions, leading to highly uncertain predictions. Instead, we propose augmenting the hyperbolic manifold with a pullback metric to account for distortions introduced by the LVM's nonlinear mapping and provide a complete development for pullback metrics of Gaussian Process LVMs (GPLVMs). Our experiments demonstrate that geodesics on the pullback metric not only respect the geometry of the hyperbolic latent space but also align with the underlying data distribution, significantly reducing uncertainty in predictions.
format Preprint
id arxiv_https___arxiv_org_abs_2410_20850
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle On Probabilistic Pullback Metrics for Latent Hyperbolic Manifolds
Augenstein, Luis
Jaquier, Noémie
Asfour, Tamim
Rozo, Leonel
Machine Learning
Probabilistic Latent Variable Models (LVMs) excel at modeling complex, high-dimensional data through lower-dimensional representations. Recent advances show that equipping these latent representations with a Riemannian metric unlocks geometry-aware distances and shortest paths that comply with the underlying data structure. This paper focuses on hyperbolic embeddings, a particularly suitable choice for modeling hierarchical relationships. Previous approaches relying on hyperbolic geodesics for interpolating the latent space often generate paths crossing low-data regions, leading to highly uncertain predictions. Instead, we propose augmenting the hyperbolic manifold with a pullback metric to account for distortions introduced by the LVM's nonlinear mapping and provide a complete development for pullback metrics of Gaussian Process LVMs (GPLVMs). Our experiments demonstrate that geodesics on the pullback metric not only respect the geometry of the hyperbolic latent space but also align with the underlying data distribution, significantly reducing uncertainty in predictions.
title On Probabilistic Pullback Metrics for Latent Hyperbolic Manifolds
topic Machine Learning
url https://arxiv.org/abs/2410.20850