Balanced Hyperbolic Embeddings Are Natural Out-of-Distribution Detectors

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kasarla, Tejaswi, van Spengler, Max, Mettes, Pascal
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911000644550656
author Kasarla, Tejaswi
van Spengler, Max
Mettes, Pascal
author_facet Kasarla, Tejaswi
van Spengler, Max
Mettes, Pascal
contents Out-of-distribution recognition forms an important and well-studied problem in deep learning, with the goal to filter out samples that do not belong to the distribution on which a network has been trained. The conclusion of this paper is simple: a good hierarchical hyperbolic embedding is preferred for discriminating in- and out-of-distribution samples. We introduce Balanced Hyperbolic Learning. We outline a hyperbolic class embedding algorithm that jointly optimizes for hierarchical distortion and balancing between shallow and wide subhierarchies. We then use the class embeddings as hyperbolic prototypes for classification on in-distribution data. We outline how to generalize existing out-of-distribution scoring functions to operate with hyperbolic prototypes. Empirical evaluations across 13 datasets and 13 scoring functions show that our hyperbolic embeddings outperform existing out-of-distribution approaches when trained on the same data with the same backbones. We also show that our hyperbolic embeddings outperform other hyperbolic approaches, beat state-of-the-art contrastive methods, and natively enable hierarchical out-of-distribution generalization.
format Preprint
id arxiv_https___arxiv_org_abs_2506_10146
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Balanced Hyperbolic Embeddings Are Natural Out-of-Distribution Detectors
Kasarla, Tejaswi
van Spengler, Max
Mettes, Pascal
Machine Learning
Computer Vision and Pattern Recognition
Out-of-distribution recognition forms an important and well-studied problem in deep learning, with the goal to filter out samples that do not belong to the distribution on which a network has been trained. The conclusion of this paper is simple: a good hierarchical hyperbolic embedding is preferred for discriminating in- and out-of-distribution samples. We introduce Balanced Hyperbolic Learning. We outline a hyperbolic class embedding algorithm that jointly optimizes for hierarchical distortion and balancing between shallow and wide subhierarchies. We then use the class embeddings as hyperbolic prototypes for classification on in-distribution data. We outline how to generalize existing out-of-distribution scoring functions to operate with hyperbolic prototypes. Empirical evaluations across 13 datasets and 13 scoring functions show that our hyperbolic embeddings outperform existing out-of-distribution approaches when trained on the same data with the same backbones. We also show that our hyperbolic embeddings outperform other hyperbolic approaches, beat state-of-the-art contrastive methods, and natively enable hierarchical out-of-distribution generalization.
title Balanced Hyperbolic Embeddings Are Natural Out-of-Distribution Detectors
topic Machine Learning
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.10146