A Comparative Study of UMAP and Other Dimensionality Reduction Methods

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Zhang, Guanzhe, Ding, Shanshan, Jin, Zhezhen
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914522995884032
author Zhang, Guanzhe
Ding, Shanshan
Jin, Zhezhen
author_facet Zhang, Guanzhe
Ding, Shanshan
Jin, Zhezhen
contents Uniform Manifold Approximation and Projection (UMAP) is a widely used manifold learning technique for dimensionality reduction. This paper studies UMAP, supervised UMAP, and several competing dimensionality reduction methods, including Principal Component Analysis (PCA), Kernel PCA, Sliced Inverse Regression (SIR), Kernel SIR, and t-distributed Stochastic Neighbor Embedding, through a comprehensive comparative analysis. Although UMAP has attracted substantial attention for preserving local and global structures, its supervised extensions, particularly for regression settings, remain rather underexplored. We provide a systematic evaluation of supervised UMAP for both regression and classification using simulated and real datasets, with performance assessed via predictive accuracy on low-dimensional embeddings. Our results show that supervised UMAP performs well for classification but exhibits limitations in effectively incorporating response information for regression, highlighting an important direction for future development.
format Preprint
id arxiv_https___arxiv_org_abs_2603_02275
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A Comparative Study of UMAP and Other Dimensionality Reduction Methods
Zhang, Guanzhe
Ding, Shanshan
Jin, Zhezhen
Machine Learning
Applications
62H25, 62J05, 68T09
Uniform Manifold Approximation and Projection (UMAP) is a widely used manifold learning technique for dimensionality reduction. This paper studies UMAP, supervised UMAP, and several competing dimensionality reduction methods, including Principal Component Analysis (PCA), Kernel PCA, Sliced Inverse Regression (SIR), Kernel SIR, and t-distributed Stochastic Neighbor Embedding, through a comprehensive comparative analysis. Although UMAP has attracted substantial attention for preserving local and global structures, its supervised extensions, particularly for regression settings, remain rather underexplored. We provide a systematic evaluation of supervised UMAP for both regression and classification using simulated and real datasets, with performance assessed via predictive accuracy on low-dimensional embeddings. Our results show that supervised UMAP performs well for classification but exhibits limitations in effectively incorporating response information for regression, highlighting an important direction for future development.
title A Comparative Study of UMAP and Other Dimensionality Reduction Methods
topic Machine Learning
Applications
62H25, 62J05, 68T09
url https://arxiv.org/abs/2603.02275