Temporal Representation Learning for Real-Time Ultrasound Analysis

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Stebler, Yves, Sutter, Thomas M., Ozkan, Ece, Vogt, Julia E.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914015888801792
author Stebler, Yves
Sutter, Thomas M.
Ozkan, Ece
Vogt, Julia E.
author_facet Stebler, Yves
Sutter, Thomas M.
Ozkan, Ece
Vogt, Julia E.
contents Ultrasound (US) imaging is a critical tool in medical diagnostics, offering real-time visualization of physiological processes. One of its major advantages is its ability to capture temporal dynamics, which is essential for assessing motion patterns in applications such as cardiac monitoring, fetal development, and vascular imaging. Despite its importance, current deep learning models often overlook the temporal continuity of ultrasound sequences, analyzing frames independently and missing key temporal dependencies. To address this gap, we propose a method for learning effective temporal representations from ultrasound videos, with a focus on echocardiography-based ejection fraction (EF) estimation. EF prediction serves as an ideal case study to demonstrate the necessity of temporal learning, as it requires capturing the rhythmic contraction and relaxation of the heart. Our approach leverages temporally consistent masking and contrastive learning to enforce temporal coherence across video frames, enhancing the model's ability to represent motion patterns. Evaluated on the EchoNet-Dynamic dataset, our method achieves a substantial improvement in EF prediction accuracy, highlighting the importance of temporally-aware representation learning for real-time ultrasound analysis.
format Preprint
id arxiv_https___arxiv_org_abs_2509_01433
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Temporal Representation Learning for Real-Time Ultrasound Analysis
Stebler, Yves
Sutter, Thomas M.
Ozkan, Ece
Vogt, Julia E.
Image and Video Processing
Machine Learning
Ultrasound (US) imaging is a critical tool in medical diagnostics, offering real-time visualization of physiological processes. One of its major advantages is its ability to capture temporal dynamics, which is essential for assessing motion patterns in applications such as cardiac monitoring, fetal development, and vascular imaging. Despite its importance, current deep learning models often overlook the temporal continuity of ultrasound sequences, analyzing frames independently and missing key temporal dependencies. To address this gap, we propose a method for learning effective temporal representations from ultrasound videos, with a focus on echocardiography-based ejection fraction (EF) estimation. EF prediction serves as an ideal case study to demonstrate the necessity of temporal learning, as it requires capturing the rhythmic contraction and relaxation of the heart. Our approach leverages temporally consistent masking and contrastive learning to enforce temporal coherence across video frames, enhancing the model's ability to represent motion patterns. Evaluated on the EchoNet-Dynamic dataset, our method achieves a substantial improvement in EF prediction accuracy, highlighting the importance of temporally-aware representation learning for real-time ultrasound analysis.
title Temporal Representation Learning for Real-Time Ultrasound Analysis
topic Image and Video Processing
Machine Learning
url https://arxiv.org/abs/2509.01433