Foundation Model of Electronic Medical Records for Adaptive Risk Estimation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Renc, Pawel, Grzeszczyk, Michal K., Oufattole, Nassim, Goode, Deirdre, Jia, Yugang, Bieganski, Szymon, McDermott, Matthew B. A., Was, Jaroslaw, Samir, Anthony E., Cunningham, Jonathan W., Bates, David W., Sitek, Arkadiusz
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912521781248000
author Renc, Pawel
Grzeszczyk, Michal K.
Oufattole, Nassim
Goode, Deirdre
Jia, Yugang
Bieganski, Szymon
McDermott, Matthew B. A.
Was, Jaroslaw
Samir, Anthony E.
Cunningham, Jonathan W.
Bates, David W.
Sitek, Arkadiusz
author_facet Renc, Pawel
Grzeszczyk, Michal K.
Oufattole, Nassim
Goode, Deirdre
Jia, Yugang
Bieganski, Szymon
McDermott, Matthew B. A.
Was, Jaroslaw
Samir, Anthony E.
Cunningham, Jonathan W.
Bates, David W.
Sitek, Arkadiusz
contents Hospitals struggle to predict critical outcomes. Traditional early warning systems, like NEWS and MEWS, rely on static variables and fixed thresholds, limiting their adaptability, accuracy, and personalization. We previously developed the Enhanced Transformer for Health Outcome Simulation (ETHOS), an AI model that tokenizes patient health timelines (PHTs) from EHRs and uses transformer-based architectures to predict future PHTs. ETHOS is a versatile framework for developing a wide range of applications. In this work, we develop the Adaptive Risk Estimation System (ARES) that leverages ETHOS to compute dynamic, personalized risk probabilities for clinician-defined critical events. ARES also features a personalized explainability module that highlights key clinical factors influencing risk estimates. We evaluated ARES using the MIMIC-IV v2.2 dataset together with its Emergency Department (ED) extension and benchmarked performance against both classical early warning systems and contemporary machine learning models. The entire dataset was tokenized resulting in 285,622 PHTs, comprising over 360 million tokens. ETHOS outperformed benchmark models in predicting hospital admissions, ICU admissions, and prolonged stays, achieving superior AUC scores. Its risk estimates were robust across demographic subgroups, with calibration curves confirming model reliability. The explainability module provided valuable insights into patient-specific risk factors. ARES, powered by ETHOS, advances predictive healthcare AI by delivering dynamic, real-time, personalized risk estimation with patient-specific explainability. Although our results are promising, the clinical impact remains uncertain. Demonstrating ARES's true utility in real-world settings will be the focus of our future work. We release the source code to facilitate future research.
format Preprint
id arxiv_https___arxiv_org_abs_2502_06124
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Foundation Model of Electronic Medical Records for Adaptive Risk Estimation
Renc, Pawel
Grzeszczyk, Michal K.
Oufattole, Nassim
Goode, Deirdre
Jia, Yugang
Bieganski, Szymon
McDermott, Matthew B. A.
Was, Jaroslaw
Samir, Anthony E.
Cunningham, Jonathan W.
Bates, David W.
Sitek, Arkadiusz
Machine Learning
Artificial Intelligence
Hospitals struggle to predict critical outcomes. Traditional early warning systems, like NEWS and MEWS, rely on static variables and fixed thresholds, limiting their adaptability, accuracy, and personalization. We previously developed the Enhanced Transformer for Health Outcome Simulation (ETHOS), an AI model that tokenizes patient health timelines (PHTs) from EHRs and uses transformer-based architectures to predict future PHTs. ETHOS is a versatile framework for developing a wide range of applications. In this work, we develop the Adaptive Risk Estimation System (ARES) that leverages ETHOS to compute dynamic, personalized risk probabilities for clinician-defined critical events. ARES also features a personalized explainability module that highlights key clinical factors influencing risk estimates. We evaluated ARES using the MIMIC-IV v2.2 dataset together with its Emergency Department (ED) extension and benchmarked performance against both classical early warning systems and contemporary machine learning models. The entire dataset was tokenized resulting in 285,622 PHTs, comprising over 360 million tokens. ETHOS outperformed benchmark models in predicting hospital admissions, ICU admissions, and prolonged stays, achieving superior AUC scores. Its risk estimates were robust across demographic subgroups, with calibration curves confirming model reliability. The explainability module provided valuable insights into patient-specific risk factors. ARES, powered by ETHOS, advances predictive healthcare AI by delivering dynamic, real-time, personalized risk estimation with patient-specific explainability. Although our results are promising, the clinical impact remains uncertain. Demonstrating ARES's true utility in real-world settings will be the focus of our future work. We release the source code to facilitate future research.
title Foundation Model of Electronic Medical Records for Adaptive Risk Estimation
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2502.06124