Salvato in:
Dettagli Bibliografici
Autori principali: Choi, Sunwoong, Kim, Samuel
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:https://arxiv.org/abs/2402.18046
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909122524348416
author Choi, Sunwoong
Kim, Samuel
author_facet Choi, Sunwoong
Kim, Samuel
contents We present a novel data augmentation method to address the challenge of data scarcity in modeling longitudinal patterns in Electronic Health Records (EHR) of patients using natural language processing (NLP) algorithms. The proposed method generates augmented data by rearranging the orders of medical records within a visit where the order of elements are not obvious, if any. Applying the proposed method to the clopidogrel treatment failure detection task enabled up to 5.3% absolute improvement in terms of ROC-AUC (from 0.908 without augmentation to 0.961 with augmentation) when it was used during the pre-training procedure. It was also shown that the augmentation helped to improve performance during fine-tuning procedures, especially when the amount of labeled training data is limited.
format Preprint
id arxiv_https___arxiv_org_abs_2402_18046
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Data augmentation method for modeling health records with applications to clopidogrel treatment failure detection
Choi, Sunwoong
Kim, Samuel
Machine Learning
We present a novel data augmentation method to address the challenge of data scarcity in modeling longitudinal patterns in Electronic Health Records (EHR) of patients using natural language processing (NLP) algorithms. The proposed method generates augmented data by rearranging the orders of medical records within a visit where the order of elements are not obvious, if any. Applying the proposed method to the clopidogrel treatment failure detection task enabled up to 5.3% absolute improvement in terms of ROC-AUC (from 0.908 without augmentation to 0.961 with augmentation) when it was used during the pre-training procedure. It was also shown that the augmentation helped to improve performance during fine-tuning procedures, especially when the amount of labeled training data is limited.
title Data augmentation method for modeling health records with applications to clopidogrel treatment failure detection
topic Machine Learning
url https://arxiv.org/abs/2402.18046