Evaluating quality in synthetic data generation for large tabular health datasets
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866918452329971712 |
|---|---|
| author | Escudié, Jean-Baptiste Barnes, Benjamin Meisegeier, Stefan Kraywinkel, Klaus Prasser, Fabian Körber, Nils |
| author_facet | Escudié, Jean-Baptiste Barnes, Benjamin Meisegeier, Stefan Kraywinkel, Klaus Prasser, Fabian Körber, Nils |
| contents | There is no consensus in the field of synthetic data on concise metrics for quality evaluations or benchmarks on large health datasets, such as historical epidemiological data. This study presents an evaluation of seven recent models from major machine learning families. The models were evaluated using four different datasets, each with a distinct scale. To ensure a fair comparison, we systematically tuned the hyperparameters of each model for each dataset. We propose a methodology for evaluating the fidelity of synthesized joint distributions, aligning metrics with visualization on a single plot. This method is applicable to any dataset and is complemented by a domain-specific analysis of the German Cancer Registries' epidemiological dataset. The analysis reveals the challenges models face in strictly adhering to the medical domain. We hope this approach will serve as a foundational framework for guiding the selection of synthesizers and remain accessible to all stakeholders involved in releasing synthetic datasets. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_15961 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Evaluating quality in synthetic data generation for large tabular health datasets Escudié, Jean-Baptiste Barnes, Benjamin Meisegeier, Stefan Kraywinkel, Klaus Prasser, Fabian Körber, Nils Machine Learning There is no consensus in the field of synthetic data on concise metrics for quality evaluations or benchmarks on large health datasets, such as historical epidemiological data. This study presents an evaluation of seven recent models from major machine learning families. The models were evaluated using four different datasets, each with a distinct scale. To ensure a fair comparison, we systematically tuned the hyperparameters of each model for each dataset. We propose a methodology for evaluating the fidelity of synthesized joint distributions, aligning metrics with visualization on a single plot. This method is applicable to any dataset and is complemented by a domain-specific analysis of the German Cancer Registries' epidemiological dataset. The analysis reveals the challenges models face in strictly adhering to the medical domain. We hope this approach will serve as a foundational framework for guiding the selection of synthesizers and remain accessible to all stakeholders involved in releasing synthetic datasets. |
| title | Evaluating quality in synthetic data generation for large tabular health datasets |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2604.15961 |