Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | https://arxiv.org/abs/2507.15900 |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866918101058060288 |
|---|---|
| author | Ascarate, Alejandro Lebrat, Leo Cruz, Rodrigo Santa Fookes, Clinton Salvado, Olivier |
| author_facet | Ascarate, Alejandro Lebrat, Leo Cruz, Rodrigo Santa Fookes, Clinton Salvado, Olivier |
| contents | Variational autoencoders (VAE) encode data into lower-dimensional latent vectors before decoding those vectors back to data. Once trained, decoding a random latent vector from the prior usually does not produce meaningful data, at least when the latent space has more than a dozen dimensions. In this paper, we investigate this issue by drawing insight from high dimensional statistics: in these regimes, the latent vectors of a standard VAE are by construction distributed uniformly on a hypersphere. We propose to formulate the latent variables of a VAE using hyperspherical coordinates, which allows compressing the latent vectors towards an island on the hypersphere, thereby reducing the latent sparsity and we show that this improves the generation ability of the VAE. We propose a new parameterization of the latent space with limited computational overhead. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_15900 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Improving the Generation of VAEs with High Dimensional Latent Spaces by the use of Hyperspherical Coordinates Ascarate, Alejandro Lebrat, Leo Cruz, Rodrigo Santa Fookes, Clinton Salvado, Olivier Machine Learning Variational autoencoders (VAE) encode data into lower-dimensional latent vectors before decoding those vectors back to data. Once trained, decoding a random latent vector from the prior usually does not produce meaningful data, at least when the latent space has more than a dozen dimensions. In this paper, we investigate this issue by drawing insight from high dimensional statistics: in these regimes, the latent vectors of a standard VAE are by construction distributed uniformly on a hypersphere. We propose to formulate the latent variables of a VAE using hyperspherical coordinates, which allows compressing the latent vectors towards an island on the hypersphere, thereby reducing the latent sparsity and we show that this improves the generation ability of the VAE. We propose a new parameterization of the latent space with limited computational overhead. |
| title | Improving the Generation of VAEs with High Dimensional Latent Spaces by the use of Hyperspherical Coordinates |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2507.15900 |