Shannon Weights for binary dynamical recurrent sources of zero entropy
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866915228321579008 |
|---|---|
| author | Akhavi, Ali Cesaratto, Eda Paccaut, Frédéric Rotondo, Pablo Vallée, Brigitte |
| author_facet | Akhavi, Ali Cesaratto, Eda Paccaut, Frédéric Rotondo, Pablo Vallée, Brigitte |
| contents | A probabilistic source is defined as the set of infinite words (over a given denumerable alphabet) endowed with a probability $μ$. The paper deals with general binary sources where the distribution of any symbol (0 or 1) may depend on an unbounded part of the previous history. The paper studies Shannon weights: whereas the classical Shannon entropy ${\cal E}_μ$ is the average amount of information brought by one symbol of the emitted word, the Shannon weight sequence deals with the average amount of information $m_μ(n)$ that is brought by the emitted prefix of length $n$. For a source with a non zero entropy, the estimate $m_μ(n)\sim{\cal E}_μ \cdot n$ thus holds. The paper considers the model of dynamical sources, where a source word isemitted as an encoded trajectory of a dynamical system of the unit interval, when endowed with probability $μ$. It focus on sources with zero entropy and gives explicit constructions for sources whose Shannon weight sequence satisfies $m_μ(n)=o(n)$, with a prescribed behaviour. In this case, sources with zero entropy lead to dynamical systems built on maps with an indifferent fixed point. This class notably contains the celebrated Farey source, which presents well-known intermittency phenomena. Methods are based on analytic combinatorics and generating functions, and they are enlarged, in the present dynamical case, with dynamical systems tools (mainly transfer operators). |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2504_03538 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Shannon Weights for binary dynamical recurrent sources of zero entropy Akhavi, Ali Cesaratto, Eda Paccaut, Frédéric Rotondo, Pablo Vallée, Brigitte Dynamical Systems Information Theory A probabilistic source is defined as the set of infinite words (over a given denumerable alphabet) endowed with a probability $μ$. The paper deals with general binary sources where the distribution of any symbol (0 or 1) may depend on an unbounded part of the previous history. The paper studies Shannon weights: whereas the classical Shannon entropy ${\cal E}_μ$ is the average amount of information brought by one symbol of the emitted word, the Shannon weight sequence deals with the average amount of information $m_μ(n)$ that is brought by the emitted prefix of length $n$. For a source with a non zero entropy, the estimate $m_μ(n)\sim{\cal E}_μ \cdot n$ thus holds. The paper considers the model of dynamical sources, where a source word isemitted as an encoded trajectory of a dynamical system of the unit interval, when endowed with probability $μ$. It focus on sources with zero entropy and gives explicit constructions for sources whose Shannon weight sequence satisfies $m_μ(n)=o(n)$, with a prescribed behaviour. In this case, sources with zero entropy lead to dynamical systems built on maps with an indifferent fixed point. This class notably contains the celebrated Farey source, which presents well-known intermittency phenomena. Methods are based on analytic combinatorics and generating functions, and they are enlarged, in the present dynamical case, with dynamical systems tools (mainly transfer operators). |
| title | Shannon Weights for binary dynamical recurrent sources of zero entropy |
| topic | Dynamical Systems Information Theory |
| url | https://arxiv.org/abs/2504.03538 |