Interpretable Dimensionality Reduction by Feature Preserving Manifold Approximation and Projection

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Yang, Yang, Sun, Hongjian, Gong, Jialei, Yu, Di
Format: Preprint
Publié: 2022
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909156329390080
author Yang, Yang
Sun, Hongjian
Gong, Jialei
Yu, Di
author_facet Yang, Yang
Sun, Hongjian
Gong, Jialei
Yu, Di
contents Nonlinear dimensionality reduction lacks interpretability due to the absence of source features in low-dimensional embedding space. We propose an interpretable method featMAP to preserve source features by tangent space embedding. The core of our proposal is to utilize local singular value decomposition (SVD) to approximate the tangent space which is embedded to low-dimensional space by maintaining the alignment. Based on the embedding tangent space, featMAP enables the interpretability by locally demonstrating the source features and feature importance. Furthermore, featMAP embeds the data points by anisotropic projection to preserve the local similarity and original density. We apply featMAP to interpreting digit classification, object detection and MNIST adversarial examples. FeatMAP uses source features to explicitly distinguish the digits and objects and to explain the misclassification of adversarial examples. We also compare featMAP with other state-of-the-art methods on local and global metrics.
format Preprint
id arxiv_https___arxiv_org_abs_2211_09321
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Interpretable Dimensionality Reduction by Feature Preserving Manifold Approximation and Projection
Yang, Yang
Sun, Hongjian
Gong, Jialei
Yu, Di
Computer Vision and Pattern Recognition
Machine Learning
Nonlinear dimensionality reduction lacks interpretability due to the absence of source features in low-dimensional embedding space. We propose an interpretable method featMAP to preserve source features by tangent space embedding. The core of our proposal is to utilize local singular value decomposition (SVD) to approximate the tangent space which is embedded to low-dimensional space by maintaining the alignment. Based on the embedding tangent space, featMAP enables the interpretability by locally demonstrating the source features and feature importance. Furthermore, featMAP embeds the data points by anisotropic projection to preserve the local similarity and original density. We apply featMAP to interpreting digit classification, object detection and MNIST adversarial examples. FeatMAP uses source features to explicitly distinguish the digits and objects and to explain the misclassification of adversarial examples. We also compare featMAP with other state-of-the-art methods on local and global metrics.
title Interpretable Dimensionality Reduction by Feature Preserving Manifold Approximation and Projection
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2211.09321