A Spectral Framework for Multi-Scale Nonlinear Dimensionality Reduction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Huang, Zeyang, Chatzimparmpas, Angelos, Höllt, Thomas, Fujiwara, Takanori
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913000888205312
author Huang, Zeyang
Chatzimparmpas, Angelos
Höllt, Thomas
Fujiwara, Takanori
author_facet Huang, Zeyang
Chatzimparmpas, Angelos
Höllt, Thomas
Fujiwara, Takanori
contents Dimensionality reduction (DR) is characterized by two longstanding trade-offs. First, there is a global-local preservation tension: methods such as t-SNE and UMAP prioritize local neighborhood preservation, yet may distort global manifold structure, while methods such as Laplacian Eigenmaps preserve global geometry but often yield limited local separation. Second, there is a gap between expressiveness and analytical transparency: many nonlinear DR methods produce embeddings without an explicit connection to the underlying high-dimensional structure, limiting insight into the embedding process. In this paper, we introduce a spectral framework for nonlinear DR that addresses these challenges. Our approach embeds high-dimensional data using a spectral basis combined with cross-entropy optimization, enabling multi-scale representations that bridge global and local structure. Leveraging linear spectral decomposition, the framework further supports analysis of embeddings through a graph-frequency perspective, enabling examination of how spectral modes influence the resulting embedding. We complement this analysis with glyph-based scatterplot augmentations for visual exploration. Quantitative evaluations and case studies demonstrate that our framework improves manifold continuity while enabling deeper analysis of embedding structure through spectral mode contributions.
format Preprint
id arxiv_https___arxiv_org_abs_2604_02535
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A Spectral Framework for Multi-Scale Nonlinear Dimensionality Reduction
Huang, Zeyang
Chatzimparmpas, Angelos
Höllt, Thomas
Fujiwara, Takanori
Machine Learning
Human-Computer Interaction
Dimensionality reduction (DR) is characterized by two longstanding trade-offs. First, there is a global-local preservation tension: methods such as t-SNE and UMAP prioritize local neighborhood preservation, yet may distort global manifold structure, while methods such as Laplacian Eigenmaps preserve global geometry but often yield limited local separation. Second, there is a gap between expressiveness and analytical transparency: many nonlinear DR methods produce embeddings without an explicit connection to the underlying high-dimensional structure, limiting insight into the embedding process. In this paper, we introduce a spectral framework for nonlinear DR that addresses these challenges. Our approach embeds high-dimensional data using a spectral basis combined with cross-entropy optimization, enabling multi-scale representations that bridge global and local structure. Leveraging linear spectral decomposition, the framework further supports analysis of embeddings through a graph-frequency perspective, enabling examination of how spectral modes influence the resulting embedding. We complement this analysis with glyph-based scatterplot augmentations for visual exploration. Quantitative evaluations and case studies demonstrate that our framework improves manifold continuity while enabling deeper analysis of embedding structure through spectral mode contributions.
title A Spectral Framework for Multi-Scale Nonlinear Dimensionality Reduction
topic Machine Learning
Human-Computer Interaction
url https://arxiv.org/abs/2604.02535