Generalized Entropy Power Inequalities and Monotonicity Properties of Information

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Madiman, Mokshay, Barron, Andrew
Natura: Preprint
Pubblicazione: 2006
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911868823535616
author Madiman, Mokshay
Barron, Andrew
author_facet Madiman, Mokshay
Barron, Andrew
contents New families of Fisher information and entropy power inequalities for sums of independent random variables are presented. These inequalities relate the information in the sum of $n$ independent random variables to the information contained in sums over subsets of the random variables, for an arbitrary collection of subsets. As a consequence, a simple proof of the monotonicity of information in central limit theorems is obtained, both in the setting of i.i.d. summands as well as in the more general setting of independent summands with variance-standardized sums.
format Preprint
id arxiv_https___arxiv_org_abs_cs_0605047
institution arXiv
publishDate 2006
record_format arxiv
spellingShingle Generalized Entropy Power Inequalities and Monotonicity Properties of Information
Madiman, Mokshay
Barron, Andrew
Information Theory
Probability
Statistics Theory
E.4; G.3
New families of Fisher information and entropy power inequalities for sums of independent random variables are presented. These inequalities relate the information in the sum of $n$ independent random variables to the information contained in sums over subsets of the random variables, for an arbitrary collection of subsets. As a consequence, a simple proof of the monotonicity of information in central limit theorems is obtained, both in the setting of i.i.d. summands as well as in the more general setting of independent summands with variance-standardized sums.
title Generalized Entropy Power Inequalities and Monotonicity Properties of Information
topic Information Theory
Probability
Statistics Theory
E.4; G.3
url https://arxiv.org/abs/cs/0605047