Generalization error property of infoGAN for two-layer neural network

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Hasan, Mahmud, Muia, Mathias
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912387460759552
author Hasan, Mahmud
Muia, Mathias
author_facet Hasan, Mahmud
Muia, Mathias
contents Information Maximizing Generative Adversarial Network (infoGAN) can be understood as a minimax problem involving two neural networks: discriminators and generators with mutual information functions. The infoGAN incorporates various components, including latent variables, mutual information, and objective function. This research demonstrates the Generalization error property of infoGAN as the discriminator and generator sample size approaches infinity. This research explores the generalization error property of InfoGAN as the sample sizes of the discriminator and generator approach infinity. To establish this property, the study considers the difference between the empirical and population versions of the objective function. The error bound is derived from the Rademacher complexity of the discriminator and generator function classes. Additionally, the bound is proven for a two-layer network, where both the discriminator and generator utilize Lipschitz and non-decreasing activation functions.
format Preprint
id arxiv_https___arxiv_org_abs_2310_00443
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle Generalization error property of infoGAN for two-layer neural network
Hasan, Mahmud
Muia, Mathias
Machine Learning
Information Maximizing Generative Adversarial Network (infoGAN) can be understood as a minimax problem involving two neural networks: discriminators and generators with mutual information functions. The infoGAN incorporates various components, including latent variables, mutual information, and objective function. This research demonstrates the Generalization error property of infoGAN as the discriminator and generator sample size approaches infinity. This research explores the generalization error property of InfoGAN as the sample sizes of the discriminator and generator approach infinity. To establish this property, the study considers the difference between the empirical and population versions of the objective function. The error bound is derived from the Rademacher complexity of the discriminator and generator function classes. Additionally, the bound is proven for a two-layer network, where both the discriminator and generator utilize Lipschitz and non-decreasing activation functions.
title Generalization error property of infoGAN for two-layer neural network
topic Machine Learning
url https://arxiv.org/abs/2310.00443