Can synthetic data reproduce real-world findings in epidemiology? A replication study using adversarial random forests
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , , , , , , , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911645305929728 |
|---|---|
| author | Kapar, Jan Günther, Kathrin Vallis, Lori Ann Berger, Klaus Binder, Nadine Brenner, Hermann Castell, Stefanie Fischer, Beate Harth, Volker Holleczek, Bernd Intemann, Timm Ittermann, Till Karch, André Keil, Thomas Krist, Lilian Lange, Berit Leitzmann, Michael F. Nimptsch, Katharina Obi, Nadia Pigeot, Iris Pischon, Tobias Schikowski, Tamara Schmidt, Börge Schmidt, Carsten Oliver Sedlmair, Anja M. Tanoey, Justine Wienbergen, Harm Wienke, Andreas Wigmann, Claudia Wright, Marvin N. |
| author_facet | Kapar, Jan Günther, Kathrin Vallis, Lori Ann Berger, Klaus Binder, Nadine Brenner, Hermann Castell, Stefanie Fischer, Beate Harth, Volker Holleczek, Bernd Intemann, Timm Ittermann, Till Karch, André Keil, Thomas Krist, Lilian Lange, Berit Leitzmann, Michael F. Nimptsch, Katharina Obi, Nadia Pigeot, Iris Pischon, Tobias Schikowski, Tamara Schmidt, Börge Schmidt, Carsten Oliver Sedlmair, Anja M. Tanoey, Justine Wienbergen, Harm Wienke, Andreas Wigmann, Claudia Wright, Marvin N. |
| contents | Synthetic data holds substantial potential to address practical challenges in epidemiology due to restricted data access and privacy concerns. However, many current methods suffer from limited quality, high computational demands, and complexity for non-experts. Furthermore, common evaluation strategies for synthetic data often fail to directly reflect statistical utility and measure privacy risks sufficiently. Against this background, a critical underexplored question is whether synthetic data can reliably reproduce key findings from epidemiological research while preserving privacy. We propose adversarial random forests (ARF) as an efficient and convenient method for synthesizing tabular epidemiological data. To evaluate its performance, we replicated statistical analyses from six epidemiological publications covering blood pressure, anthropometry, myocardial infarction, accelerometry, loneliness, and diabetes, from the German National Cohort (NAKO Gesundheitsstudie), the Bremen STEMI Registry U45 Study, and the Guelph Family Health Study. We further assessed how dataset dimensionality and variable complexity affect the quality of synthetic data, and contextualized ARF's performance by comparison with commonly used tabular data synthesizers in terms of utility, privacy, generalisation, and runtime. Across all replicated studies, results on ARF-generated synthetic data consistently aligned with original findings. Even for datasets with relatively low sample size-to-dimensionality ratios, replication outcomes closely matched the original results across descriptive and inferential analyses. Reduced dimensionality and variable complexity further enhanced synthesis quality. ARF demonstrated favourable performance regarding utility, privacy preservation, and generalisation relative to other synthesizers and superior computational efficiency. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_14936 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Can synthetic data reproduce real-world findings in epidemiology? A replication study using adversarial random forests Kapar, Jan Günther, Kathrin Vallis, Lori Ann Berger, Klaus Binder, Nadine Brenner, Hermann Castell, Stefanie Fischer, Beate Harth, Volker Holleczek, Bernd Intemann, Timm Ittermann, Till Karch, André Keil, Thomas Krist, Lilian Lange, Berit Leitzmann, Michael F. Nimptsch, Katharina Obi, Nadia Pigeot, Iris Pischon, Tobias Schikowski, Tamara Schmidt, Börge Schmidt, Carsten Oliver Sedlmair, Anja M. Tanoey, Justine Wienbergen, Harm Wienke, Andreas Wigmann, Claudia Wright, Marvin N. Quantitative Methods Artificial Intelligence Machine Learning Applications Synthetic data holds substantial potential to address practical challenges in epidemiology due to restricted data access and privacy concerns. However, many current methods suffer from limited quality, high computational demands, and complexity for non-experts. Furthermore, common evaluation strategies for synthetic data often fail to directly reflect statistical utility and measure privacy risks sufficiently. Against this background, a critical underexplored question is whether synthetic data can reliably reproduce key findings from epidemiological research while preserving privacy. We propose adversarial random forests (ARF) as an efficient and convenient method for synthesizing tabular epidemiological data. To evaluate its performance, we replicated statistical analyses from six epidemiological publications covering blood pressure, anthropometry, myocardial infarction, accelerometry, loneliness, and diabetes, from the German National Cohort (NAKO Gesundheitsstudie), the Bremen STEMI Registry U45 Study, and the Guelph Family Health Study. We further assessed how dataset dimensionality and variable complexity affect the quality of synthetic data, and contextualized ARF's performance by comparison with commonly used tabular data synthesizers in terms of utility, privacy, generalisation, and runtime. Across all replicated studies, results on ARF-generated synthetic data consistently aligned with original findings. Even for datasets with relatively low sample size-to-dimensionality ratios, replication outcomes closely matched the original results across descriptive and inferential analyses. Reduced dimensionality and variable complexity further enhanced synthesis quality. ARF demonstrated favourable performance regarding utility, privacy preservation, and generalisation relative to other synthesizers and superior computational efficiency. |
| title | Can synthetic data reproduce real-world findings in epidemiology? A replication study using adversarial random forests |
| topic | Quantitative Methods Artificial Intelligence Machine Learning Applications |
| url | https://arxiv.org/abs/2508.14936 |