Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.20808 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914996717355008 |
|---|---|
| author | Azimi, Azizjon Boboeva, Bonu Varshavskiy, Ilyas Khalilbekov, Shuhrat Nizamitdinov, Akhlitdin Noyoftova, Najima Shulgin, Sergey |
| author_facet | Azimi, Azizjon Boboeva, Bonu Varshavskiy, Ilyas Khalilbekov, Shuhrat Nizamitdinov, Akhlitdin Noyoftova, Najima Shulgin, Sergey |
| contents | The phenomenon of "black swans" has posed a fundamental challenge to performance of classical machine learning models. The perceived rise in frequency of outlier conditions, especially in post-pandemic environment, has necessitated exploration of synthetic data as a complement to real data in model training. This article provides a general overview and experimental investigation of the zGAN model architecture developed for the purpose of generating synthetic tabular data with outlier characteristics. The model is put to test in binary classification environments and shows promising results on realistic synthetic data generation, as well as uplift capabilities vis-à-vis model performance. A distinctive feature of zGAN is its enhanced correlation capability between features in the generated data, replicating correlations of features in real training data. Furthermore, crucial is the ability of zGAN to generate outliers based on covariance of real data or synthetically generated covariances. This approach to outlier generation enables modeling of complex economic events and augmentation of outliers for tasks such as training predictive models and detecting, processing or removing outliers. Experiments and comparative analyses as part of this study were conducted on both private (credit risk in financial services) and public datasets. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_20808 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | zGAN: An Outlier-focused Generative Adversarial Network For Realistic Synthetic Data Generation Azimi, Azizjon Boboeva, Bonu Varshavskiy, Ilyas Khalilbekov, Shuhrat Nizamitdinov, Akhlitdin Noyoftova, Najima Shulgin, Sergey Machine Learning The phenomenon of "black swans" has posed a fundamental challenge to performance of classical machine learning models. The perceived rise in frequency of outlier conditions, especially in post-pandemic environment, has necessitated exploration of synthetic data as a complement to real data in model training. This article provides a general overview and experimental investigation of the zGAN model architecture developed for the purpose of generating synthetic tabular data with outlier characteristics. The model is put to test in binary classification environments and shows promising results on realistic synthetic data generation, as well as uplift capabilities vis-à-vis model performance. A distinctive feature of zGAN is its enhanced correlation capability between features in the generated data, replicating correlations of features in real training data. Furthermore, crucial is the ability of zGAN to generate outliers based on covariance of real data or synthetically generated covariances. This approach to outlier generation enables modeling of complex economic events and augmentation of outliers for tasks such as training predictive models and detecting, processing or removing outliers. Experiments and comparative analyses as part of this study were conducted on both private (credit risk in financial services) and public datasets. |
| title | zGAN: An Outlier-focused Generative Adversarial Network For Realistic Synthetic Data Generation |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2410.20808 |