Feature Space Topology Control via Hopkins Loss

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Vaaras, Einari, Airaksinen, Manu
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866914294188212224
author Vaaras, Einari
Airaksinen, Manu
author_facet Vaaras, Einari
Airaksinen, Manu
contents Feature space topology refers to the organization of samples within the feature space. Modifying this topology can be beneficial in machine learning applications, including dimensionality reduction, generative modeling, transfer learning, and robustness to adversarial attacks. This paper introduces a novel loss function, Hopkins loss, which leverages the Hopkins statistic to enforce a desired feature space topology, which is in contrast to existing topology-related methods that aim to preserve input feature topology. We evaluate the effectiveness of Hopkins loss on speech, text, and image data in two scenarios: classification and dimensionality reduction using nonlinear bottleneck autoencoders. Our experiments show that integrating Hopkins loss into classification or dimensionality reduction has only a small impact on classification performance while providing the benefit of modifying feature topology.
format Preprint
id arxiv_https___arxiv_org_abs_2509_11154
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Feature Space Topology Control via Hopkins Loss
Vaaras, Einari
Airaksinen, Manu
Machine Learning
Artificial Intelligence
Feature space topology refers to the organization of samples within the feature space. Modifying this topology can be beneficial in machine learning applications, including dimensionality reduction, generative modeling, transfer learning, and robustness to adversarial attacks. This paper introduces a novel loss function, Hopkins loss, which leverages the Hopkins statistic to enforce a desired feature space topology, which is in contrast to existing topology-related methods that aim to preserve input feature topology. We evaluate the effectiveness of Hopkins loss on speech, text, and image data in two scenarios: classification and dimensionality reduction using nonlinear bottleneck autoencoders. Our experiments show that integrating Hopkins loss into classification or dimensionality reduction has only a small impact on classification performance while providing the benefit of modifying feature topology.
title Feature Space Topology Control via Hopkins Loss
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2509.11154