Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2508.05348 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916885276131328 |
|---|---|
| author | Castellano, Riccardo Sekatski, Pavel |
| author_facet | Castellano, Riccardo Sekatski, Pavel |
| contents | We derive an asymptotic lower bound on the Shannon entropy $H$ of sums of $N$ arbitrary iid discrete random variables. The derived bound $H \geq \frac{r(X)}{2}\log(N) + {\it cst}$ is given in terms of the incommensurability rank $r(X)$ of the random variable -- a positive integer quantity that we introduce. The derivation does not rely on central limit theorems, but builds upon the known expressions of the asymptotic entropy of the multinomial distribution and sums of iid lattice random variables, which correspond to the case $r(X)=1$. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_05348 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | On the entropy growth of sums of iid discrete random variables Castellano, Riccardo Sekatski, Pavel Information Theory We derive an asymptotic lower bound on the Shannon entropy $H$ of sums of $N$ arbitrary iid discrete random variables. The derived bound $H \geq \frac{r(X)}{2}\log(N) + {\it cst}$ is given in terms of the incommensurability rank $r(X)$ of the random variable -- a positive integer quantity that we introduce. The derivation does not rely on central limit theorems, but builds upon the known expressions of the asymptotic entropy of the multinomial distribution and sums of iid lattice random variables, which correspond to the case $r(X)=1$. |
| title | On the entropy growth of sums of iid discrete random variables |
| topic | Information Theory |
| url | https://arxiv.org/abs/2508.05348 |