The Efficacy of Semantics-Preserving Transformations in Self-Supervised Learning for Medical Ultrasound

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: VanBerlo, Blake, Wong, Alexander, Hoey, Jesse, Arntfield, Robert
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913888927219712
author VanBerlo, Blake
Wong, Alexander
Hoey, Jesse
Arntfield, Robert
author_facet VanBerlo, Blake
Wong, Alexander
Hoey, Jesse
Arntfield, Robert
contents Data augmentation is a central component of joint embedding self-supervised learning (SSL). Approaches that work for natural images may not always be effective in medical imaging tasks. This study systematically investigated the impact of data augmentation and preprocessing strategies in SSL for lung ultrasound. Three data augmentation pipelines were assessed: (1) a baseline pipeline commonly used across imaging domains, (2) a novel semantic-preserving pipeline designed for ultrasound, and (3) a distilled set of the most effective transformations from both pipelines. Pretrained models were evaluated on multiple classification tasks: B-line detection, pleural effusion detection, and COVID-19 classification. Experiments revealed that semantics-preserving data augmentation resulted in the greatest performance for COVID-19 classification - a diagnostic task requiring global image context. Cropping-based methods yielded the greatest performance on the B-line and pleural effusion object classification tasks, which require strong local pattern recognition. Lastly, semantics-preserving ultrasound image preprocessing resulted in increased downstream performance for multiple tasks. Guidance regarding data augmentation and preprocessing strategies was synthesized for practitioners working with SSL in ultrasound.
format Preprint
id arxiv_https___arxiv_org_abs_2504_07904
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle The Efficacy of Semantics-Preserving Transformations in Self-Supervised Learning for Medical Ultrasound
VanBerlo, Blake
Wong, Alexander
Hoey, Jesse
Arntfield, Robert
Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
I.2.10; I.4.9; J.3
Data augmentation is a central component of joint embedding self-supervised learning (SSL). Approaches that work for natural images may not always be effective in medical imaging tasks. This study systematically investigated the impact of data augmentation and preprocessing strategies in SSL for lung ultrasound. Three data augmentation pipelines were assessed: (1) a baseline pipeline commonly used across imaging domains, (2) a novel semantic-preserving pipeline designed for ultrasound, and (3) a distilled set of the most effective transformations from both pipelines. Pretrained models were evaluated on multiple classification tasks: B-line detection, pleural effusion detection, and COVID-19 classification. Experiments revealed that semantics-preserving data augmentation resulted in the greatest performance for COVID-19 classification - a diagnostic task requiring global image context. Cropping-based methods yielded the greatest performance on the B-line and pleural effusion object classification tasks, which require strong local pattern recognition. Lastly, semantics-preserving ultrasound image preprocessing resulted in increased downstream performance for multiple tasks. Guidance regarding data augmentation and preprocessing strategies was synthesized for practitioners working with SSL in ultrasound.
title The Efficacy of Semantics-Preserving Transformations in Self-Supervised Learning for Medical Ultrasound
topic Image and Video Processing
Computer Vision and Pattern Recognition
Machine Learning
I.2.10; I.4.9; J.3
url https://arxiv.org/abs/2504.07904