Max-Sliced Wasserstein Distance and its use for GANs
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2019
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866918150952452096 |
|---|---|
| author | Deshpande, Ishan Hu, Yuan-Ting Sun, Ruoyu Pyrros, Ayis Siddiqui, Nasir Koyejo, Sanmi Zhao, Zhizhen Forsyth, David Schwing, Alexander |
| author_facet | Deshpande, Ishan Hu, Yuan-Ting Sun, Ruoyu Pyrros, Ayis Siddiqui, Nasir Koyejo, Sanmi Zhao, Zhizhen Forsyth, David Schwing, Alexander |
| contents | Generative adversarial nets (GANs) and variational auto-encoders have significantly improved our distribution modeling capabilities, showing promise for dataset augmentation, image-to-image translation and feature learning. However, to model high-dimensional distributions, sequential training and stacked architectures are common, increasing the number of tunable hyper-parameters as well as the training time. Nonetheless, the sample complexity of the distance metrics remains one of the factors affecting GAN training. We first show that the recently proposed sliced Wasserstein distance has compelling sample complexity properties when compared to the Wasserstein distance. To further improve the sliced Wasserstein distance we then analyze its `projection complexity' and develop the max-sliced Wasserstein distance which enjoys compelling sample complexity while reducing projection complexity, albeit necessitating a max estimation. We finally illustrate that the proposed distance trains GANs on high-dimensional images up to a resolution of 256x256 easily. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_1904_05877 |
| institution | arXiv |
| publishDate | 2019 |
| record_format | arxiv |
| spellingShingle | Max-Sliced Wasserstein Distance and its use for GANs Deshpande, Ishan Hu, Yuan-Ting Sun, Ruoyu Pyrros, Ayis Siddiqui, Nasir Koyejo, Sanmi Zhao, Zhizhen Forsyth, David Schwing, Alexander Machine Learning Computer Vision and Pattern Recognition Generative adversarial nets (GANs) and variational auto-encoders have significantly improved our distribution modeling capabilities, showing promise for dataset augmentation, image-to-image translation and feature learning. However, to model high-dimensional distributions, sequential training and stacked architectures are common, increasing the number of tunable hyper-parameters as well as the training time. Nonetheless, the sample complexity of the distance metrics remains one of the factors affecting GAN training. We first show that the recently proposed sliced Wasserstein distance has compelling sample complexity properties when compared to the Wasserstein distance. To further improve the sliced Wasserstein distance we then analyze its `projection complexity' and develop the max-sliced Wasserstein distance which enjoys compelling sample complexity while reducing projection complexity, albeit necessitating a max estimation. We finally illustrate that the proposed distance trains GANs on high-dimensional images up to a resolution of 256x256 easily. |
| title | Max-Sliced Wasserstein Distance and its use for GANs |
| topic | Machine Learning Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/1904.05877 |