The Rashomon Effect for Visualizing High-Dimensional Data

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Sun, Yiyang, Huang, Haiyang, Parikh, Gaurav Rajesh, Rudin, Cynthia
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908996715151360
author Sun, Yiyang
Huang, Haiyang
Parikh, Gaurav Rajesh
Rudin, Cynthia
author_facet Sun, Yiyang
Huang, Haiyang
Parikh, Gaurav Rajesh
Rudin, Cynthia
contents Dimension reduction (DR) is inherently non-unique: multiple embeddings can preserve the structure of high-dimensional data equally well while differing in layout or geometry. In this paper, we formally define the Rashomon set for DR -- the collection of `good' embedding -- and show how embracing this multiplicity leads to more powerful and trustworthy representations. Specifically, we pursue three goals. First, we introduce PCA-informed alignment to steer embeddings toward principal components, making axes interpretable without distorting local neighborhoods. Second, we design concept-alignment regularization that aligns an embedding dimension with external knowledge, such as class labels or user-defined concepts. Third, we propose a method to extract common knowledge across the Rashomon set by identifying trustworthy and persistent nearest-neighbor relationships, which we use to construct refined embeddings with improved local structure while preserving global relationships. By moving beyond a single embedding and leveraging the Rashomon set, we provide a flexible framework for building interpretable, robust, and goal-aligned visualizations.
format Preprint
id arxiv_https___arxiv_org_abs_2604_00485
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle The Rashomon Effect for Visualizing High-Dimensional Data
Sun, Yiyang
Huang, Haiyang
Parikh, Gaurav Rajesh
Rudin, Cynthia
Machine Learning
Dimension reduction (DR) is inherently non-unique: multiple embeddings can preserve the structure of high-dimensional data equally well while differing in layout or geometry. In this paper, we formally define the Rashomon set for DR -- the collection of `good' embedding -- and show how embracing this multiplicity leads to more powerful and trustworthy representations. Specifically, we pursue three goals. First, we introduce PCA-informed alignment to steer embeddings toward principal components, making axes interpretable without distorting local neighborhoods. Second, we design concept-alignment regularization that aligns an embedding dimension with external knowledge, such as class labels or user-defined concepts. Third, we propose a method to extract common knowledge across the Rashomon set by identifying trustworthy and persistent nearest-neighbor relationships, which we use to construct refined embeddings with improved local structure while preserving global relationships. By moving beyond a single embedding and leveraging the Rashomon set, we provide a flexible framework for building interpretable, robust, and goal-aligned visualizations.
title The Rashomon Effect for Visualizing High-Dimensional Data
topic Machine Learning
url https://arxiv.org/abs/2604.00485