Salvato in:
| Autori principali: | , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | https://arxiv.org/abs/2502.09715 |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909493070135296 |
|---|---|
| author | Leng, Yu He, Yingnan Magdamo, Colin Vranceanu, Ana-Maria Ritchie, Christine S. Mukerji, Shibani S. Moura, Lidia M. V. R. Dickson, John R. Blacker, Deborah Das, Sudeshna |
| author_facet | Leng, Yu He, Yingnan Magdamo, Colin Vranceanu, Ana-Maria Ritchie, Christine S. Mukerji, Shibani S. Moura, Lidia M. V. R. Dickson, John R. Blacker, Deborah Das, Sudeshna |
| contents | Identifying cognitive impairment within electronic health records (EHRs) is crucial not only for timely diagnoses but also for facilitating research. Information about cognitive impairment often exists within unstructured clinician notes in EHRs, but manual chart reviews are both time-consuming and error-prone. To address this issue, our study evaluates an automated approach using zero-shot GPT-4o to determine stage of cognitive impairment in two different tasks. First, we evaluated the ability of GPT-4o to determine the global Clinical Dementia Rating (CDR) on specialist notes from 769 patients who visited the memory clinic at Massachusetts General Hospital (MGH), and achieved a weighted kappa score of 0.83. Second, we assessed GPT-4o's ability to differentiate between normal cognition, mild cognitive impairment (MCI), and dementia on all notes in a 3-year window from 860 Medicare patients. GPT-4o attained a weighted kappa score of 0.91 in comparison to specialist chart reviews and 0.96 on cases that the clinical adjudicators rated with high confidence. Our findings demonstrate GPT-4o's potential as a scalable chart review tool for creating research datasets and assisting diagnosis in clinical settings in the future. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_09715 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Evaluating GPT's Capability in Identifying Stages of Cognitive Impairment from Electronic Health Data Leng, Yu He, Yingnan Magdamo, Colin Vranceanu, Ana-Maria Ritchie, Christine S. Mukerji, Shibani S. Moura, Lidia M. V. R. Dickson, John R. Blacker, Deborah Das, Sudeshna Machine Learning Artificial Intelligence Computation and Language Identifying cognitive impairment within electronic health records (EHRs) is crucial not only for timely diagnoses but also for facilitating research. Information about cognitive impairment often exists within unstructured clinician notes in EHRs, but manual chart reviews are both time-consuming and error-prone. To address this issue, our study evaluates an automated approach using zero-shot GPT-4o to determine stage of cognitive impairment in two different tasks. First, we evaluated the ability of GPT-4o to determine the global Clinical Dementia Rating (CDR) on specialist notes from 769 patients who visited the memory clinic at Massachusetts General Hospital (MGH), and achieved a weighted kappa score of 0.83. Second, we assessed GPT-4o's ability to differentiate between normal cognition, mild cognitive impairment (MCI), and dementia on all notes in a 3-year window from 860 Medicare patients. GPT-4o attained a weighted kappa score of 0.91 in comparison to specialist chart reviews and 0.96 on cases that the clinical adjudicators rated with high confidence. Our findings demonstrate GPT-4o's potential as a scalable chart review tool for creating research datasets and assisting diagnosis in clinical settings in the future. |
| title | Evaluating GPT's Capability in Identifying Stages of Cognitive Impairment from Electronic Health Data |
| topic | Machine Learning Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2502.09715 |