On the uniqueness of the coupled entropy
Fuente:
arXiv
Gespeichert in:
| 1. Verfasser: | |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866908761071812608 |
|---|---|
| author | Nelson, Kenric P. |
| author_facet | Nelson, Kenric P. |
| contents | The coupled entropy, $H_κ,$ is proven to uniquely satisfy the requirement that a generalized entropy be a measure of the uncertainty at the scale, $σ,$ for a class of non-exponential distributions. The coupled stretched exponential distributions, including the generalized Pareto and Student's t distributions, are uniquely parameterized to quantify linear uncertainty with the scale and nonlinear uncertainty with the tail shape for a broad class of complex systems. Thereby, the coupled entropy optimizes the representation of the uncertainty due to linear sources. Lemmas for the composability and extensivity of the coupled entropy are proven. The uniqueness of the coupled entropy is further supported by demonstrating consistent thermodynamic relationships, which correspond to a model used for the momentum of high-energy particle collisions. Applications of the coupled entropy in measuring statistical complexity, training variational inference algorithms, and designing communication channels are reviewed. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_17684 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | On the uniqueness of the coupled entropy Nelson, Kenric P. Statistical Mechanics Information Theory Data Analysis, Statistics and Probability 94A17, 60K35, 80A05, 62G32 The coupled entropy, $H_κ,$ is proven to uniquely satisfy the requirement that a generalized entropy be a measure of the uncertainty at the scale, $σ,$ for a class of non-exponential distributions. The coupled stretched exponential distributions, including the generalized Pareto and Student's t distributions, are uniquely parameterized to quantify linear uncertainty with the scale and nonlinear uncertainty with the tail shape for a broad class of complex systems. Thereby, the coupled entropy optimizes the representation of the uncertainty due to linear sources. Lemmas for the composability and extensivity of the coupled entropy are proven. The uniqueness of the coupled entropy is further supported by demonstrating consistent thermodynamic relationships, which correspond to a model used for the momentum of high-energy particle collisions. Applications of the coupled entropy in measuring statistical complexity, training variational inference algorithms, and designing communication channels are reviewed. |
| title | On the uniqueness of the coupled entropy |
| topic | Statistical Mechanics Information Theory Data Analysis, Statistics and Probability 94A17, 60K35, 80A05, 62G32 |
| url | https://arxiv.org/abs/2511.17684 |