Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2403.12158 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909140107919360 |
|---|---|
| author | Pal, Samyajoy Heumann, Christian |
| author_facet | Pal, Samyajoy Heumann, Christian |
| contents | This study tackles the efficient estimation of Kullback-Leibler (KL) Divergence in Dirichlet Mixture Models (DMM), crucial for clustering compositional data. Despite the significance of DMMs, obtaining an analytically tractable solution for KL Divergence has proven elusive. Past approaches relied on computationally demanding Monte Carlo methods, motivating our introduction of a novel variational approach. Our method offers a closed-form solution, significantly enhancing computational efficiency for swift model comparisons and robust estimation evaluations. Validation using real and simulated data showcases its superior efficiency and accuracy over traditional Monte Carlo-based methods, opening new avenues for rapid exploration of diverse DMM models and advancing statistical analyses of compositional data. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_12158 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Variational Approach for Efficient KL Divergence Estimation in Dirichlet Mixture Models Pal, Samyajoy Heumann, Christian Machine Learning Statistics Theory This study tackles the efficient estimation of Kullback-Leibler (KL) Divergence in Dirichlet Mixture Models (DMM), crucial for clustering compositional data. Despite the significance of DMMs, obtaining an analytically tractable solution for KL Divergence has proven elusive. Past approaches relied on computationally demanding Monte Carlo methods, motivating our introduction of a novel variational approach. Our method offers a closed-form solution, significantly enhancing computational efficiency for swift model comparisons and robust estimation evaluations. Validation using real and simulated data showcases its superior efficiency and accuracy over traditional Monte Carlo-based methods, opening new avenues for rapid exploration of diverse DMM models and advancing statistical analyses of compositional data. |
| title | Variational Approach for Efficient KL Divergence Estimation in Dirichlet Mixture Models |
| topic | Machine Learning Statistics Theory |
| url | https://arxiv.org/abs/2403.12158 |