Foundation Model for Cardiac Time Series via Masked Latent Attention
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911607662051328 |
|---|---|
| author | Vandenhirtz, Moritz Ruipérez-Campillo, Samuel Böhi, Simon Laguna, Sonia Cannistraci, Irene Agostini, Andrea Ozkan, Ece Sutter, Thomas M. Vogt, Julia E. |
| author_facet | Vandenhirtz, Moritz Ruipérez-Campillo, Samuel Böhi, Simon Laguna, Sonia Cannistraci, Irene Agostini, Andrea Ozkan, Ece Sutter, Thomas M. Vogt, Julia E. |
| contents | Electrocardiograms (ECGs) are among the most widely available clinical signals and play a central role in cardiovascular diagnosis. While recent foundation models (FMs) have shown promise for learning transferable ECG representations, most existing pretraining approaches treat leads as independent channels and fail to explicitly leverage their strong structural redundancy. We introduce the latent attention masked autoencoder (LAMAE) FM that directly exploits this structure by learning cross-lead connection mechanisms during self-supervised pretraining. Our approach models higher-order interactions across leads through latent attention, enabling permutation-invariant aggregation and adaptive weighting of lead-specific representations. We provide empirical evidence on the Mimic-IV-ECG database that leveraging the cross-lead connection constitutes an effective form of structural supervision, improving representation quality and transferability. Our method shows strong performance in predicting ICD-10 codes, outperforming independent-lead masked modeling and alignment-based baselines. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_26475 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Foundation Model for Cardiac Time Series via Masked Latent Attention Vandenhirtz, Moritz Ruipérez-Campillo, Samuel Böhi, Simon Laguna, Sonia Cannistraci, Irene Agostini, Andrea Ozkan, Ece Sutter, Thomas M. Vogt, Julia E. Machine Learning Artificial Intelligence Signal Processing Representation Theory Electrocardiograms (ECGs) are among the most widely available clinical signals and play a central role in cardiovascular diagnosis. While recent foundation models (FMs) have shown promise for learning transferable ECG representations, most existing pretraining approaches treat leads as independent channels and fail to explicitly leverage their strong structural redundancy. We introduce the latent attention masked autoencoder (LAMAE) FM that directly exploits this structure by learning cross-lead connection mechanisms during self-supervised pretraining. Our approach models higher-order interactions across leads through latent attention, enabling permutation-invariant aggregation and adaptive weighting of lead-specific representations. We provide empirical evidence on the Mimic-IV-ECG database that leveraging the cross-lead connection constitutes an effective form of structural supervision, improving representation quality and transferability. Our method shows strong performance in predicting ICD-10 codes, outperforming independent-lead masked modeling and alignment-based baselines. |
| title | Foundation Model for Cardiac Time Series via Masked Latent Attention |
| topic | Machine Learning Artificial Intelligence Signal Processing Representation Theory |
| url | https://arxiv.org/abs/2603.26475 |