Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2605.17758 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913137677041664 |
|---|---|
| author | Nagesh, Nitish Bagheri, Mahdi Puthran, Arshia Harish Zhou, Pengbao Love, Muhjaazee Sharma, Aadi Harris, Ian Rahmani, Amir M. |
| author_facet | Nagesh, Nitish Bagheri, Mahdi Puthran, Arshia Harish Zhou, Pengbao Love, Muhjaazee Sharma, Aadi Harris, Ian Rahmani, Amir M. |
| contents | Synthetic data is widely used in healthcare to create datasets that are similar to original data but without the privacy concerns. Generating and evaluating synthetic data across privacy, utility and fairness is crucial for facilitating high quality data availability for downstream prediction tasks and clinical decision making. We present Memisis, a tool that orchestrates and evaluates synthetic data by leveraging existing synthetic data tools, the power of large language models and state-of-the-art evaluation metrics. Our tool creates a unified workflow for data generation, validation and evaluation. Users have control over the training size, training epochs and the number of synthetic rows to sample. Instead of knobs to tune synthetic data, the interactive agent allows users to specify their synthetic data generation goals and the tool will orchestrate the workflow by leveraging existing tools while performing the requisite evaluation. For the demo, we use an open source schizophrenia dataset with protected attributes related to race and gender, three different synthesizers and a local language model to orchestrate the workflow. We observe that CTGAN, TVAE and GaussianCopula have comparable performance across fairness and utility metrics. The workflow allows users flexibility and control over the data generation and evaluation process. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_17758 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Memisis: Orchestrating and Evaluating Synthetic Data for Tabular Health Datasets Nagesh, Nitish Bagheri, Mahdi Puthran, Arshia Harish Zhou, Pengbao Love, Muhjaazee Sharma, Aadi Harris, Ian Rahmani, Amir M. Machine Learning Synthetic data is widely used in healthcare to create datasets that are similar to original data but without the privacy concerns. Generating and evaluating synthetic data across privacy, utility and fairness is crucial for facilitating high quality data availability for downstream prediction tasks and clinical decision making. We present Memisis, a tool that orchestrates and evaluates synthetic data by leveraging existing synthetic data tools, the power of large language models and state-of-the-art evaluation metrics. Our tool creates a unified workflow for data generation, validation and evaluation. Users have control over the training size, training epochs and the number of synthetic rows to sample. Instead of knobs to tune synthetic data, the interactive agent allows users to specify their synthetic data generation goals and the tool will orchestrate the workflow by leveraging existing tools while performing the requisite evaluation. For the demo, we use an open source schizophrenia dataset with protected attributes related to race and gender, three different synthesizers and a local language model to orchestrate the workflow. We observe that CTGAN, TVAE and GaussianCopula have comparable performance across fairness and utility metrics. The workflow allows users flexibility and control over the data generation and evaluation process. |
| title | Memisis: Orchestrating and Evaluating Synthetic Data for Tabular Health Datasets |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2605.17758 |