LINGUAL: Language-INtegrated GUidance in Active Learning for Medical Image Segmentation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Islam, Md Shazid, Bera, Shreyangshu, Paul, Sudipta, Roy-Chowdhury, Amit K.
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914162065539072
author Islam, Md Shazid
Bera, Shreyangshu
Paul, Sudipta
Roy-Chowdhury, Amit K.
author_facet Islam, Md Shazid
Bera, Shreyangshu
Paul, Sudipta
Roy-Chowdhury, Amit K.
contents Although active learning (AL) in segmentation tasks enables experts to annotate selected regions of interest (ROIs) instead of entire images, it remains highly challenging, labor-intensive, and cognitively demanding due to the blurry and ambiguous boundaries commonly observed in medical images. Also, in conventional AL, annotation effort is a function of the ROI- larger regions make the task cognitively easier but incur higher annotation costs, whereas smaller regions demand finer precision and more attention from the expert. In this context, language guidance provides an effective alternative, requiring minimal expert effort while bypassing the cognitively demanding task of precise boundary delineation in segmentation. Towards this goal, we introduce LINGUAL: a framework that receives natural language instructions from an expert, translates them into executable programs through in-context learning, and automatically performs the corresponding sequence of sub-tasks without any human intervention. We demonstrate the effectiveness of LINGUAL in active domain adaptation (ADA) achieving comparable or superior performance to AL baselines while reducing estimated annotation time by approximately 80%.
format Preprint
id arxiv_https___arxiv_org_abs_2511_14028
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle LINGUAL: Language-INtegrated GUidance in Active Learning for Medical Image Segmentation
Islam, Md Shazid
Bera, Shreyangshu
Paul, Sudipta
Roy-Chowdhury, Amit K.
Computer Vision and Pattern Recognition
Although active learning (AL) in segmentation tasks enables experts to annotate selected regions of interest (ROIs) instead of entire images, it remains highly challenging, labor-intensive, and cognitively demanding due to the blurry and ambiguous boundaries commonly observed in medical images. Also, in conventional AL, annotation effort is a function of the ROI- larger regions make the task cognitively easier but incur higher annotation costs, whereas smaller regions demand finer precision and more attention from the expert. In this context, language guidance provides an effective alternative, requiring minimal expert effort while bypassing the cognitively demanding task of precise boundary delineation in segmentation. Towards this goal, we introduce LINGUAL: a framework that receives natural language instructions from an expert, translates them into executable programs through in-context learning, and automatically performs the corresponding sequence of sub-tasks without any human intervention. We demonstrate the effectiveness of LINGUAL in active domain adaptation (ADA) achieving comparable or superior performance to AL baselines while reducing estimated annotation time by approximately 80%.
title LINGUAL: Language-INtegrated GUidance in Active Learning for Medical Image Segmentation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.14028