Saved in:
| Main Author: | |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2601.03064 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914610700877824 |
|---|---|
| author | Miller, Joseph Samuel |
| author_facet | Miller, Joseph Samuel |
| contents | Similarity-sensitive entropy measures the uncertainty of a probability law relative to a similarity kernel that encodes the distinguishability between states. We develop a measure-theoretic treatment covering both finite similarity matrices and general probability spaces, and study how the law and similarity kernel transform under measurable maps, Markov kernels (channels), and conditioning operations. This yields deterministic and channel data-processing inequalities, so a reduction in entropy quantifies how much distinguishability is lost under representation change. We also define a conditional similarity sensitive entropy theory, give a counterexample to a recent conjecture on concavity, and identify a useful one-dimensional Laplace pullback class where concavity holds. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_03064 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Similarity-Sensitive Entropy under Representation Change and Inference Miller, Joseph Samuel Probability Information Theory Similarity-sensitive entropy measures the uncertainty of a probability law relative to a similarity kernel that encodes the distinguishability between states. We develop a measure-theoretic treatment covering both finite similarity matrices and general probability spaces, and study how the law and similarity kernel transform under measurable maps, Markov kernels (channels), and conditioning operations. This yields deterministic and channel data-processing inequalities, so a reduction in entropy quantifies how much distinguishability is lost under representation change. We also define a conditional similarity sensitive entropy theory, give a counterexample to a recent conjecture on concavity, and identify a useful one-dimensional Laplace pullback class where concavity holds. |
| title | Similarity-Sensitive Entropy under Representation Change and Inference |
| topic | Probability Information Theory |
| url | https://arxiv.org/abs/2601.03064 |