DREAMS: Preserving both Local and Global Structure in Dimensionality Reduction

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Kury, Noël, Kobak, Dmitry, Damrich, Sebastian
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866910005767176192
author Kury, Noël
Kobak, Dmitry
Damrich, Sebastian
author_facet Kury, Noël
Kobak, Dmitry
Damrich, Sebastian
contents Dimensionality reduction techniques are widely used for visualizing high-dimensional data in two dimensions. Existing methods are typically designed to preserve either local (e.g., $t$-SNE, UMAP) or global (e.g., MDS, PCA) structure of the data, but none of the established methods can represent both aspects well. In this paper, we present DREAMS (Dimensionality Reduction Enhanced Across Multiple Scales), a method that combines the local structure preservation of $t$-SNE with the global structure preservation of PCA via a simple regularization term. Our approach generates a spectrum of embeddings between the locally well-structured $t$-SNE embedding and the globally well-structured PCA embedding, efficiently balancing both local and global structure preservation. We benchmark DREAMS across eleven real-world datasets, showcasing qualitatively and quantitatively its superior ability to preserve structure across multiple scales compared to previous approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2508_13747
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DREAMS: Preserving both Local and Global Structure in Dimensionality Reduction
Kury, Noël
Kobak, Dmitry
Damrich, Sebastian
Machine Learning
Dimensionality reduction techniques are widely used for visualizing high-dimensional data in two dimensions. Existing methods are typically designed to preserve either local (e.g., $t$-SNE, UMAP) or global (e.g., MDS, PCA) structure of the data, but none of the established methods can represent both aspects well. In this paper, we present DREAMS (Dimensionality Reduction Enhanced Across Multiple Scales), a method that combines the local structure preservation of $t$-SNE with the global structure preservation of PCA via a simple regularization term. Our approach generates a spectrum of embeddings between the locally well-structured $t$-SNE embedding and the globally well-structured PCA embedding, efficiently balancing both local and global structure preservation. We benchmark DREAMS across eleven real-world datasets, showcasing qualitatively and quantitatively its superior ability to preserve structure across multiple scales compared to previous approaches.
title DREAMS: Preserving both Local and Global Structure in Dimensionality Reduction
topic Machine Learning
url https://arxiv.org/abs/2508.13747