Saved in:
Bibliographic Details
Main Authors: Levine, Lionel, Santerre, John, Young, Alex S., Levine, T. Barry, Campion, Francis, Sarrafzadeh, Majid
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2506.11082
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913890776907776
author Levine, Lionel
Santerre, John
Young, Alex S.
Levine, T. Barry
Campion, Francis
Sarrafzadeh, Majid
author_facet Levine, Lionel
Santerre, John
Young, Alex S.
Levine, T. Barry
Campion, Francis
Sarrafzadeh, Majid
contents We introduce PRISM (Predictive Reasoning in Sequential Medicine), a transformer-based architecture designed to model the sequential progression of clinical decision-making processes. Unlike traditional approaches that rely on isolated diagnostic classification, PRISM frames clinical trajectories as tokenized sequences of events - including diagnostic tests, laboratory results, and diagnoses - and learns to predict the most probable next steps in the patient diagnostic journey. Leveraging a large custom clinical vocabulary and an autoregressive training objective, PRISM demonstrates the ability to capture complex dependencies across longitudinal patient timelines. Experimental results show substantial improvements over random baselines in next-token prediction tasks, with generated sequences reflecting realistic diagnostic pathways, laboratory result progressions, and clinician ordering behaviors. These findings highlight the feasibility of applying generative language modeling techniques to structured medical event data, enabling applications in clinical decision support, simulation, and education. PRISM establishes a foundation for future advancements in sequence-based healthcare modeling, bridging the gap between machine learning architectures and real-world diagnostic reasoning.
format Preprint
id arxiv_https___arxiv_org_abs_2506_11082
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle PRISM: A Transformer-based Language Model of Structured Clinical Event Data
Levine, Lionel
Santerre, John
Young, Alex S.
Levine, T. Barry
Campion, Francis
Sarrafzadeh, Majid
Computation and Language
Artificial Intelligence
We introduce PRISM (Predictive Reasoning in Sequential Medicine), a transformer-based architecture designed to model the sequential progression of clinical decision-making processes. Unlike traditional approaches that rely on isolated diagnostic classification, PRISM frames clinical trajectories as tokenized sequences of events - including diagnostic tests, laboratory results, and diagnoses - and learns to predict the most probable next steps in the patient diagnostic journey. Leveraging a large custom clinical vocabulary and an autoregressive training objective, PRISM demonstrates the ability to capture complex dependencies across longitudinal patient timelines. Experimental results show substantial improvements over random baselines in next-token prediction tasks, with generated sequences reflecting realistic diagnostic pathways, laboratory result progressions, and clinician ordering behaviors. These findings highlight the feasibility of applying generative language modeling techniques to structured medical event data, enabling applications in clinical decision support, simulation, and education. PRISM establishes a foundation for future advancements in sequence-based healthcare modeling, bridging the gap between machine learning architectures and real-world diagnostic reasoning.
title PRISM: A Transformer-based Language Model of Structured Clinical Event Data
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2506.11082