Diagonal Gaussian Mixture Models and Higher Order Tensor Decompositions
Fuente:
arXiv
Salvato in:
| Autori principali: | , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911745819279360 |
|---|---|
| author | Guo, Bingni Nie, Jiawang Yang, Zi |
| author_facet | Guo, Bingni Nie, Jiawang Yang, Zi |
| contents | This paper studies how to recover parameters in diagonal Gaussian mixture models using tensors. High-order moments of the Gaussian mixture model are estimated from samples. They form incomplete symmetric tensors generated by hidden parameters in the model. We propose to use generating polynomials to compute incomplete symmetric tensor approximations. The obtained decomposition is utilized to recover parameters in the model. We prove that our recovered parameters are accurate when the estimated moments are accurate. Using high-order moments enables our algorithm to learn Gaussian mixtures with more components. For a given model dimension and order, we provide an upper bound of the number of components in the Gaussian mixture model that our algorithm can compute. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2401_01337 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Diagonal Gaussian Mixture Models and Higher Order Tensor Decompositions Guo, Bingni Nie, Jiawang Yang, Zi Numerical Analysis 15A69, 65F99 This paper studies how to recover parameters in diagonal Gaussian mixture models using tensors. High-order moments of the Gaussian mixture model are estimated from samples. They form incomplete symmetric tensors generated by hidden parameters in the model. We propose to use generating polynomials to compute incomplete symmetric tensor approximations. The obtained decomposition is utilized to recover parameters in the model. We prove that our recovered parameters are accurate when the estimated moments are accurate. Using high-order moments enables our algorithm to learn Gaussian mixtures with more components. For a given model dimension and order, we provide an upper bound of the number of components in the Gaussian mixture model that our algorithm can compute. |
| title | Diagonal Gaussian Mixture Models and Higher Order Tensor Decompositions |
| topic | Numerical Analysis 15A69, 65F99 |
| url | https://arxiv.org/abs/2401.01337 |