Saved in:
Bibliographic Details
Main Authors: Pal, Samyajoy, Heumann, Christian
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2403.12158
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909140107919360
author Pal, Samyajoy
Heumann, Christian
author_facet Pal, Samyajoy
Heumann, Christian
contents This study tackles the efficient estimation of Kullback-Leibler (KL) Divergence in Dirichlet Mixture Models (DMM), crucial for clustering compositional data. Despite the significance of DMMs, obtaining an analytically tractable solution for KL Divergence has proven elusive. Past approaches relied on computationally demanding Monte Carlo methods, motivating our introduction of a novel variational approach. Our method offers a closed-form solution, significantly enhancing computational efficiency for swift model comparisons and robust estimation evaluations. Validation using real and simulated data showcases its superior efficiency and accuracy over traditional Monte Carlo-based methods, opening new avenues for rapid exploration of diverse DMM models and advancing statistical analyses of compositional data.
format Preprint
id arxiv_https___arxiv_org_abs_2403_12158
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Variational Approach for Efficient KL Divergence Estimation in Dirichlet Mixture Models
Pal, Samyajoy
Heumann, Christian
Machine Learning
Statistics Theory
This study tackles the efficient estimation of Kullback-Leibler (KL) Divergence in Dirichlet Mixture Models (DMM), crucial for clustering compositional data. Despite the significance of DMMs, obtaining an analytically tractable solution for KL Divergence has proven elusive. Past approaches relied on computationally demanding Monte Carlo methods, motivating our introduction of a novel variational approach. Our method offers a closed-form solution, significantly enhancing computational efficiency for swift model comparisons and robust estimation evaluations. Validation using real and simulated data showcases its superior efficiency and accuracy over traditional Monte Carlo-based methods, opening new avenues for rapid exploration of diverse DMM models and advancing statistical analyses of compositional data.
title Variational Approach for Efficient KL Divergence Estimation in Dirichlet Mixture Models
topic Machine Learning
Statistics Theory
url https://arxiv.org/abs/2403.12158