Intriguing Properties of Modern GANs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Friedman, Roy, Weiss, Yair
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911781470863360
author Friedman, Roy
Weiss, Yair
author_facet Friedman, Roy
Weiss, Yair
contents Modern GANs achieve remarkable performance in terms of generating realistic and diverse samples. This has led many to believe that ``GANs capture the training data manifold''. In this work we show that this interpretation is wrong. We empirically show that the manifold learned by modern GANs does not fit the training distribution: specifically the manifold does not pass through the training examples and passes closer to out-of-distribution images than to in-distribution images. We also investigate the distribution over images implied by the prior over the latent codes and study whether modern GANs learn a density that approximates the training distribution. Surprisingly, we find that the learned density is very far from the data distribution and that GANs tend to assign higher density to out-of-distribution images. Finally, we demonstrate that the set of images used to train modern GANs are often not part of the typical set described by the GANs' distribution.
format Preprint
id arxiv_https___arxiv_org_abs_2402_14098
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Intriguing Properties of Modern GANs
Friedman, Roy
Weiss, Yair
Machine Learning
Computer Vision and Pattern Recognition
Modern GANs achieve remarkable performance in terms of generating realistic and diverse samples. This has led many to believe that ``GANs capture the training data manifold''. In this work we show that this interpretation is wrong. We empirically show that the manifold learned by modern GANs does not fit the training distribution: specifically the manifold does not pass through the training examples and passes closer to out-of-distribution images than to in-distribution images. We also investigate the distribution over images implied by the prior over the latent codes and study whether modern GANs learn a density that approximates the training distribution. Surprisingly, we find that the learned density is very far from the data distribution and that GANs tend to assign higher density to out-of-distribution images. Finally, we demonstrate that the set of images used to train modern GANs are often not part of the typical set described by the GANs' distribution.
title Intriguing Properties of Modern GANs
topic Machine Learning
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2402.14098