Zero Shot Health Trajectory Prediction Using Transformer

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Renc, Pawel, Jia, Yugang, Samir, Anthony E., Was, Jaroslaw, Li, Quanzheng, Bates, David W., Sitek, Arkadiusz
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866929704740585472
author Renc, Pawel
Jia, Yugang
Samir, Anthony E.
Was, Jaroslaw
Li, Quanzheng
Bates, David W.
Sitek, Arkadiusz
author_facet Renc, Pawel
Jia, Yugang
Samir, Anthony E.
Was, Jaroslaw
Li, Quanzheng
Bates, David W.
Sitek, Arkadiusz
contents Integrating modern machine learning and clinical decision-making has great promise for mitigating healthcare's increasing cost and complexity. We introduce the Enhanced Transformer for Health Outcome Simulation (ETHOS), a novel application of the transformer deep-learning architecture for analyzing high-dimensional, heterogeneous, and episodic health data. ETHOS is trained using Patient Health Timelines (PHTs)-detailed, tokenized records of health events-to predict future health trajectories, leveraging a zero-shot learning approach. ETHOS represents a significant advancement in foundation model development for healthcare analytics, eliminating the need for labeled data and model fine-tuning. Its ability to simulate various treatment pathways and consider patient-specific factors positions ETHOS as a tool for care optimization and addressing biases in healthcare delivery. Future developments will expand ETHOS' capabilities to incorporate a wider range of data types and data sources. Our work demonstrates a pathway toward accelerated AI development and deployment in healthcare.
format Preprint
id arxiv_https___arxiv_org_abs_2407_21124
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Zero Shot Health Trajectory Prediction Using Transformer
Renc, Pawel
Jia, Yugang
Samir, Anthony E.
Was, Jaroslaw
Li, Quanzheng
Bates, David W.
Sitek, Arkadiusz
Machine Learning
Artificial Intelligence
Computers and Society
Integrating modern machine learning and clinical decision-making has great promise for mitigating healthcare's increasing cost and complexity. We introduce the Enhanced Transformer for Health Outcome Simulation (ETHOS), a novel application of the transformer deep-learning architecture for analyzing high-dimensional, heterogeneous, and episodic health data. ETHOS is trained using Patient Health Timelines (PHTs)-detailed, tokenized records of health events-to predict future health trajectories, leveraging a zero-shot learning approach. ETHOS represents a significant advancement in foundation model development for healthcare analytics, eliminating the need for labeled data and model fine-tuning. Its ability to simulate various treatment pathways and consider patient-specific factors positions ETHOS as a tool for care optimization and addressing biases in healthcare delivery. Future developments will expand ETHOS' capabilities to incorporate a wider range of data types and data sources. Our work demonstrates a pathway toward accelerated AI development and deployment in healthcare.
title Zero Shot Health Trajectory Prediction Using Transformer
topic Machine Learning
Artificial Intelligence
Computers and Society
url https://arxiv.org/abs/2407.21124