Condensation Transition in Entropy-Constrained Probability Spaces

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Arenaza, Bautista, Risau-Gusman, Sebastián, Samengo, Inés, Hernández, Damián G.
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918492483092480
author Arenaza, Bautista
Risau-Gusman, Sebastián
Samengo, Inés
Hernández, Damián G.
author_facet Arenaza, Bautista
Risau-Gusman, Sebastián
Samengo, Inés
Hernández, Damián G.
contents The organization of high-dimensional probability spaces is a fundamental problem at the intersection of statistical physics and information theory. Here, we analyze the distributions populating level surfaces of the probability simplex $Δ_{K-1}$ defined by a fixed Shannon entropy. We introduce a discretization strategy that assigns equal statistical weight to distinct microstate distributions and enables a combinatorial analysis of the simplex. A condensation phase transition is shown to take place below a critical entropy that scales as $H_c \simeq \log K - 1 + γ$ in the thermodynamic limit. For entropy values $H_0 < H_c$, the overwhelming majority of distributions are found in a condensed state, in which a single component captures a macroscopic fraction of the total probability mass while the remaining components form a homogeneous fluid background. These results provide a framework for understanding phenomena such as overconfident predictions in machine learning and the emergence of dominant species in ecology, and suggest that sparsity can arise naturally from entropic constraints in high-dimensional manifolds.
format Preprint
id arxiv_https___arxiv_org_abs_2605_08967
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Condensation Transition in Entropy-Constrained Probability Spaces
Arenaza, Bautista
Risau-Gusman, Sebastián
Samengo, Inés
Hernández, Damián G.
Statistical Mechanics
Mathematical Physics
Quantitative Methods
The organization of high-dimensional probability spaces is a fundamental problem at the intersection of statistical physics and information theory. Here, we analyze the distributions populating level surfaces of the probability simplex $Δ_{K-1}$ defined by a fixed Shannon entropy. We introduce a discretization strategy that assigns equal statistical weight to distinct microstate distributions and enables a combinatorial analysis of the simplex. A condensation phase transition is shown to take place below a critical entropy that scales as $H_c \simeq \log K - 1 + γ$ in the thermodynamic limit. For entropy values $H_0 < H_c$, the overwhelming majority of distributions are found in a condensed state, in which a single component captures a macroscopic fraction of the total probability mass while the remaining components form a homogeneous fluid background. These results provide a framework for understanding phenomena such as overconfident predictions in machine learning and the emergence of dominant species in ecology, and suggest that sparsity can arise naturally from entropic constraints in high-dimensional manifolds.
title Condensation Transition in Entropy-Constrained Probability Spaces
topic Statistical Mechanics
Mathematical Physics
Quantitative Methods
url https://arxiv.org/abs/2605.08967