Reading Your Heart: Learning ECG Words and Sentences via Pre-training ECG Language Model

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Jin, Jiarui, Wang, Haoyu, Li, Hongyan, Li, Jun, Pan, Jiahui, Hong, Shenda
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916617031516160
author Jin, Jiarui
Wang, Haoyu
Li, Hongyan
Li, Jun
Pan, Jiahui
Hong, Shenda
author_facet Jin, Jiarui
Wang, Haoyu
Li, Hongyan
Li, Jun
Pan, Jiahui
Hong, Shenda
contents Electrocardiogram (ECG) is essential for the clinical diagnosis of arrhythmias and other heart diseases, but deep learning methods based on ECG often face limitations due to the need for high-quality annotations. Although previous ECG self-supervised learning (eSSL) methods have made significant progress in representation learning from unannotated ECG data, they typically treat ECG signals as ordinary time-series data, segmenting the signals using fixed-size and fixed-step time windows, which often ignore the form and rhythm characteristics and latent semantic relationships in ECG signals. In this work, we introduce a novel perspective on ECG signals, treating heartbeats as words and rhythms as sentences. Based on this perspective, we first designed the QRS-Tokenizer, which generates semantically meaningful ECG sentences from the raw ECG signals. Building on these, we then propose HeartLang, a novel self-supervised learning framework for ECG language processing, learning general representations at form and rhythm levels. Additionally, we construct the largest heartbeat-based ECG vocabulary to date, which will further advance the development of ECG language processing. We evaluated HeartLang across six public ECG datasets, where it demonstrated robust competitiveness against other eSSL methods. Our data and code are publicly available at https://github.com/PKUDigitalHealth/HeartLang.
format Preprint
id arxiv_https___arxiv_org_abs_2502_10707
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Reading Your Heart: Learning ECG Words and Sentences via Pre-training ECG Language Model
Jin, Jiarui
Wang, Haoyu
Li, Hongyan
Li, Jun
Pan, Jiahui
Hong, Shenda
Machine Learning
Artificial Intelligence
Electrocardiogram (ECG) is essential for the clinical diagnosis of arrhythmias and other heart diseases, but deep learning methods based on ECG often face limitations due to the need for high-quality annotations. Although previous ECG self-supervised learning (eSSL) methods have made significant progress in representation learning from unannotated ECG data, they typically treat ECG signals as ordinary time-series data, segmenting the signals using fixed-size and fixed-step time windows, which often ignore the form and rhythm characteristics and latent semantic relationships in ECG signals. In this work, we introduce a novel perspective on ECG signals, treating heartbeats as words and rhythms as sentences. Based on this perspective, we first designed the QRS-Tokenizer, which generates semantically meaningful ECG sentences from the raw ECG signals. Building on these, we then propose HeartLang, a novel self-supervised learning framework for ECG language processing, learning general representations at form and rhythm levels. Additionally, we construct the largest heartbeat-based ECG vocabulary to date, which will further advance the development of ECG language processing. We evaluated HeartLang across six public ECG datasets, where it demonstrated robust competitiveness against other eSSL methods. Our data and code are publicly available at https://github.com/PKUDigitalHealth/HeartLang.
title Reading Your Heart: Learning ECG Words and Sentences via Pre-training ECG Language Model
topic Machine Learning
Artificial Intelligence
url https://arxiv.org/abs/2502.10707