Towards a framework on tabular synthetic data generation: a minimalist approach: theory, use cases, and limitations
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866915026207506432 |
|---|---|
| author | Shen, Yueyang Sudjianto, Agus R, Arun Prakash Bhattacharyya, Anwesha Rao, Maorong Wang, Yaqun Vaughan, Joel Zhou, Nengfeng |
| author_facet | Shen, Yueyang Sudjianto, Agus R, Arun Prakash Bhattacharyya, Anwesha Rao, Maorong Wang, Yaqun Vaughan, Joel Zhou, Nengfeng |
| contents | We propose and study a minimalist approach towards synthetic tabular data generation. The model consists of a minimalistic unsupervised SparsePCA encoder (with contingent clustering step or log transformation to handle nonlinearity) and XGboost decoder which is SOTA for structured data regression and classification tasks. We study and contrast the methodologies with (variational) autoencoders in several toy low dimensional scenarios to derive necessary intuitions. The framework is applied to high dimensional simulated credit scoring data which parallels real-life financial applications. We applied the method to robustness testing to demonstrate practical use cases. The case study result suggests that the method provides an alternative to raw and quantile perturbation for model robustness testing. We show that the method is simplistic, guarantees interpretability all the way through, does not require extra tuning and provide unique benefits. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_10982 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Towards a framework on tabular synthetic data generation: a minimalist approach: theory, use cases, and limitations Shen, Yueyang Sudjianto, Agus R, Arun Prakash Bhattacharyya, Anwesha Rao, Maorong Wang, Yaqun Vaughan, Joel Zhou, Nengfeng Machine Learning Methodology We propose and study a minimalist approach towards synthetic tabular data generation. The model consists of a minimalistic unsupervised SparsePCA encoder (with contingent clustering step or log transformation to handle nonlinearity) and XGboost decoder which is SOTA for structured data regression and classification tasks. We study and contrast the methodologies with (variational) autoencoders in several toy low dimensional scenarios to derive necessary intuitions. The framework is applied to high dimensional simulated credit scoring data which parallels real-life financial applications. We applied the method to robustness testing to demonstrate practical use cases. The case study result suggests that the method provides an alternative to raw and quantile perturbation for model robustness testing. We show that the method is simplistic, guarantees interpretability all the way through, does not require extra tuning and provide unique benefits. |
| title | Towards a framework on tabular synthetic data generation: a minimalist approach: theory, use cases, and limitations |
| topic | Machine Learning Methodology |
| url | https://arxiv.org/abs/2411.10982 |