ChronoFormer: Time-Aware Transformer Architectures for Structured Clinical Event Modeling

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Yuanyun, Li, Shi
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912319475286016
author Zhang, Yuanyun
Li, Shi
author_facet Zhang, Yuanyun
Li, Shi
contents The temporal complexity of electronic health record (EHR) data presents significant challenges for predicting clinical outcomes using machine learning. This paper proposes ChronoFormer, an innovative transformer based architecture specifically designed to encode and leverage temporal dependencies in longitudinal patient data. ChronoFormer integrates temporal embeddings, hierarchical attention mechanisms, and domain specific masking techniques. Extensive experiments conducted on three benchmark tasks mortality prediction, readmission prediction, and long term comorbidity onset demonstrate substantial improvements over current state of the art methods. Furthermore, detailed analyses of attention patterns underscore ChronoFormer's capability to capture clinically meaningful long range temporal relationships.
format Preprint
id arxiv_https___arxiv_org_abs_2504_07373
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle ChronoFormer: Time-Aware Transformer Architectures for Structured Clinical Event Modeling
Zhang, Yuanyun
Li, Shi
Machine Learning
Artificial Intelligence
The temporal complexity of electronic health record (EHR) data presents significant challenges for predicting clinical outcomes using machine learning. This paper proposes ChronoFormer, an innovative transformer based architecture specifically designed to encode and leverage temporal dependencies in longitudinal patient data. ChronoFormer integrates temporal embeddings, hierarchical attention mechanisms, and domain specific masking techniques. Extensive experiments conducted on three benchmark tasks mortality prediction, readmission prediction, and long term comorbidity onset demonstrate substantial improvements over current state of the art methods. Furthermore, detailed analyses of attention patterns underscore ChronoFormer's capability to capture clinically meaningful long range temporal relationships.
title ChronoFormer: Time-Aware Transformer Architectures for Structured Clinical Event Modeling
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2504.07373