Autoadaptive Medical Segment Anything Model

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Ward, Tyler, Owen, Meredith K., Coleman, O'Kira, Noehren, Brian, Imran, Abdullah-Al-Zubaer
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866917054106304512
author Ward, Tyler
Owen, Meredith K.
Coleman, O'Kira
Noehren, Brian
Imran, Abdullah-Al-Zubaer
author_facet Ward, Tyler
Owen, Meredith K.
Coleman, O'Kira
Noehren, Brian
Imran, Abdullah-Al-Zubaer
contents Medical image segmentation is a key task in the imaging workflow, influencing many image-based decisions. Traditional, fully-supervised segmentation models rely on large amounts of labeled training data, typically obtained through manual annotation, which can be an expensive, time-consuming, and error-prone process. This signals a need for accurate, automatic, and annotation-efficient methods of training these models. We propose ADA-SAM (automated, domain-specific, and adaptive segment anything model), a novel multitask learning framework for medical image segmentation that leverages class activation maps from an auxiliary classifier to guide the predictions of the semi-supervised segmentation branch, which is based on the Segment Anything (SAM) framework. Additionally, our ADA-SAM model employs a novel gradient feedback mechanism to create a learnable connection between the segmentation and classification branches by using the segmentation gradients to guide and improve the classification predictions. We validate ADA-SAM on real-world clinical data collected during rehabilitation trials, and demonstrate that our proposed method outperforms both fully-supervised and semi-supervised baselines by double digits in limited label settings. Our code is available at: https://github.com/tbwa233/ADA-SAM.
format Preprint
id arxiv_https___arxiv_org_abs_2507_01828
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Autoadaptive Medical Segment Anything Model
Ward, Tyler
Owen, Meredith K.
Coleman, O'Kira
Noehren, Brian
Imran, Abdullah-Al-Zubaer
Image and Video Processing
Computer Vision and Pattern Recognition
Medical image segmentation is a key task in the imaging workflow, influencing many image-based decisions. Traditional, fully-supervised segmentation models rely on large amounts of labeled training data, typically obtained through manual annotation, which can be an expensive, time-consuming, and error-prone process. This signals a need for accurate, automatic, and annotation-efficient methods of training these models. We propose ADA-SAM (automated, domain-specific, and adaptive segment anything model), a novel multitask learning framework for medical image segmentation that leverages class activation maps from an auxiliary classifier to guide the predictions of the semi-supervised segmentation branch, which is based on the Segment Anything (SAM) framework. Additionally, our ADA-SAM model employs a novel gradient feedback mechanism to create a learnable connection between the segmentation and classification branches by using the segmentation gradients to guide and improve the classification predictions. We validate ADA-SAM on real-world clinical data collected during rehabilitation trials, and demonstrate that our proposed method outperforms both fully-supervised and semi-supervised baselines by double digits in limited label settings. Our code is available at: https://github.com/tbwa233/ADA-SAM.
title Autoadaptive Medical Segment Anything Model
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.01828