Improving Variational Autoencoder Estimation from Incomplete Data with Mixture Variational Families
Fuente:
arXiv
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910503581777920 |
|---|---|
| author | Simkus, Vaidotas Gutmann, Michael U. |
| author_facet | Simkus, Vaidotas Gutmann, Michael U. |
| contents | We consider the task of estimating variational autoencoders (VAEs) when the training data is incomplete. We show that missing data increases the complexity of the model's posterior distribution over the latent variables compared to the fully-observed case. The increased complexity may adversely affect the fit of the model due to a mismatch between the variational and model posterior distributions. We introduce two strategies based on (i) finite variational-mixture and (ii) imputation-based variational-mixture distributions to address the increased posterior complexity. Through a comprehensive evaluation of the proposed approaches, we show that variational mixtures are effective at improving the accuracy of VAE estimation from incomplete data. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_03069 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Improving Variational Autoencoder Estimation from Incomplete Data with Mixture Variational Families Simkus, Vaidotas Gutmann, Michael U. Machine Learning 62D10 I.2.6; G.3 We consider the task of estimating variational autoencoders (VAEs) when the training data is incomplete. We show that missing data increases the complexity of the model's posterior distribution over the latent variables compared to the fully-observed case. The increased complexity may adversely affect the fit of the model due to a mismatch between the variational and model posterior distributions. We introduce two strategies based on (i) finite variational-mixture and (ii) imputation-based variational-mixture distributions to address the increased posterior complexity. Through a comprehensive evaluation of the proposed approaches, we show that variational mixtures are effective at improving the accuracy of VAE estimation from incomplete data. |
| title | Improving Variational Autoencoder Estimation from Incomplete Data with Mixture Variational Families |
| topic | Machine Learning 62D10 I.2.6; G.3 |
| url | https://arxiv.org/abs/2403.03069 |