Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2501.02553 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912177855660032 |
|---|---|
| author | Pavel, Ievlev Shashkov, Timofei |
| author_facet | Pavel, Ievlev Shashkov, Timofei |
| contents | In this paper, we derive some upper and lower bounds and inequalities for the total variation distance (TVD) and the Kullback-Leibler divergence (KLD), also known as the relative entropy, between two probability measures $μ$ and $ν$ defined by $$
D_{\mathrm{TV}} ( μ, ν) = \sup_{B \in \mathcal{B} (\mathbb{R}^n)}
\left| μ(B) - ν(B) \right|
\quad \text{and} \quad
D_{\mathrm{KL}} ( μ\, \| \, ν) = \int_{\mathbb{R}^n}
\ln \left( \frac{dμ(x)}{dν(x)} \right) \, μ(dx) $$ correspondingly when the dimension $n$ is high. We begin with some elementary bounds for centered elliptical distributions admitting densities and showcase how these bounds may be used by estimating the TVD and KLD between multivariate Student and multivariate normal distribution in the high-dimensional setting. Next, we show how the same approach simplifies when we apply it to multivariate Gamma distributions with independent components (in the latter case, we only study the TVD, because KLD may be calculated explicitly, see [1]). Our approach is motivated by the recent contribution by Barabesi and Pratelli [2]. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_02553 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Upper and lower bounds on TVD and KLD between centered elliptical distributions in high-dimensional setting Pavel, Ievlev Shashkov, Timofei Probability Statistics Theory 60E15, 62H05 In this paper, we derive some upper and lower bounds and inequalities for the total variation distance (TVD) and the Kullback-Leibler divergence (KLD), also known as the relative entropy, between two probability measures $μ$ and $ν$ defined by $$ D_{\mathrm{TV}} ( μ, ν) = \sup_{B \in \mathcal{B} (\mathbb{R}^n)} \left| μ(B) - ν(B) \right| \quad \text{and} \quad D_{\mathrm{KL}} ( μ\, \| \, ν) = \int_{\mathbb{R}^n} \ln \left( \frac{dμ(x)}{dν(x)} \right) \, μ(dx) $$ correspondingly when the dimension $n$ is high. We begin with some elementary bounds for centered elliptical distributions admitting densities and showcase how these bounds may be used by estimating the TVD and KLD between multivariate Student and multivariate normal distribution in the high-dimensional setting. Next, we show how the same approach simplifies when we apply it to multivariate Gamma distributions with independent components (in the latter case, we only study the TVD, because KLD may be calculated explicitly, see [1]). Our approach is motivated by the recent contribution by Barabesi and Pratelli [2]. |
| title | Upper and lower bounds on TVD and KLD between centered elliptical distributions in high-dimensional setting |
| topic | Probability Statistics Theory 60E15, 62H05 |
| url | https://arxiv.org/abs/2501.02553 |