Beyond Independent Frames: Latent Attention Masked Autoencoders for Multi-View Echocardiography
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911598673657856 |
|---|---|
| author | Böhi, Simon Cannistraci, Irene Gonzalez, Sergio Muñoz Vandenhirtz, Moritz Laguna, Sonia Ruiperez-Campillo, Samuel Krähenmann, Max Agostini, Andrea Ozkan, Ece Sutter, Thomas M. Vogt, Julia E. |
| author_facet | Böhi, Simon Cannistraci, Irene Gonzalez, Sergio Muñoz Vandenhirtz, Moritz Laguna, Sonia Ruiperez-Campillo, Samuel Krähenmann, Max Agostini, Andrea Ozkan, Ece Sutter, Thomas M. Vogt, Julia E. |
| contents | Echocardiography is a widely used modality for cardiac assessment due to its non-invasive and cost-effective nature, but the sparse and heterogeneous spatiotemporal views of the heart pose distinct challenges. Existing masked autoencoder (MAE) approaches typically process images or short clips independently, failing to capture the inherent multi-view structure required for coherent cardiac representation. We introduce Latent Attention Masked Autoencoder (LAMAE), a foundation model architecture tailored to the multi-view nature of medical imaging. LAMAE augments the standard MAE with a latent attention module that enables information exchange across frames and views directly in latent space. This allows the model to aggregate variable-length sequences and distinct views, reconstructing a holistic representation of cardiac function from partial observations. We pretrain LAMAE on MIMIC-IV-ECHO, a large-scale, uncurated dataset reflecting real-world clinical variability. To the best of our knowledge, we present the first results for predicting ICD-10 codes from MIMIC-IV-ECHO videos. Furthermore, we empirically demonstrate that representations learned from adult data transfer effectively to pediatric cohorts despite substantial anatomical differences. These results provide evidence that incorporating structural priors, such as multi-view attention, yields significantly more robust and transferable representations. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_15096 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Beyond Independent Frames: Latent Attention Masked Autoencoders for Multi-View Echocardiography Böhi, Simon Cannistraci, Irene Gonzalez, Sergio Muñoz Vandenhirtz, Moritz Laguna, Sonia Ruiperez-Campillo, Samuel Krähenmann, Max Agostini, Andrea Ozkan, Ece Sutter, Thomas M. Vogt, Julia E. Computer Vision and Pattern Recognition Machine Learning Echocardiography is a widely used modality for cardiac assessment due to its non-invasive and cost-effective nature, but the sparse and heterogeneous spatiotemporal views of the heart pose distinct challenges. Existing masked autoencoder (MAE) approaches typically process images or short clips independently, failing to capture the inherent multi-view structure required for coherent cardiac representation. We introduce Latent Attention Masked Autoencoder (LAMAE), a foundation model architecture tailored to the multi-view nature of medical imaging. LAMAE augments the standard MAE with a latent attention module that enables information exchange across frames and views directly in latent space. This allows the model to aggregate variable-length sequences and distinct views, reconstructing a holistic representation of cardiac function from partial observations. We pretrain LAMAE on MIMIC-IV-ECHO, a large-scale, uncurated dataset reflecting real-world clinical variability. To the best of our knowledge, we present the first results for predicting ICD-10 codes from MIMIC-IV-ECHO videos. Furthermore, we empirically demonstrate that representations learned from adult data transfer effectively to pediatric cohorts despite substantial anatomical differences. These results provide evidence that incorporating structural priors, such as multi-view attention, yields significantly more robust and transferable representations. |
| title | Beyond Independent Frames: Latent Attention Masked Autoencoders for Multi-View Echocardiography |
| topic | Computer Vision and Pattern Recognition Machine Learning |
| url | https://arxiv.org/abs/2604.15096 |