Prompt Mechanisms in Medical Imaging: A Comprehensive Survey

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yang, Hao, Liang, Xinlong, Li, Zhang, Sun, Yue, Hu, Zheyu, Xie, Xinghe, Dashtbozorg, Behdad, Huang, Jincheng, Zhu, Shiwei, Han, Luyi, Zhang, Jiong, Wang, Shanshan, Mann, Ritse, Yu, Qifeng, Tan, Tao
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866911033121046528
author Yang, Hao
Liang, Xinlong
Li, Zhang
Sun, Yue
Hu, Zheyu
Xie, Xinghe
Dashtbozorg, Behdad
Huang, Jincheng
Zhu, Shiwei
Han, Luyi
Zhang, Jiong
Wang, Shanshan
Mann, Ritse
Yu, Qifeng
Tan, Tao
author_facet Yang, Hao
Liang, Xinlong
Li, Zhang
Sun, Yue
Hu, Zheyu
Xie, Xinghe
Dashtbozorg, Behdad
Huang, Jincheng
Zhu, Shiwei
Han, Luyi
Zhang, Jiong
Wang, Shanshan
Mann, Ritse
Yu, Qifeng
Tan, Tao
contents Deep learning offers transformative potential in medical imaging, yet its clinical adoption is frequently hampered by challenges such as data scarcity, distribution shifts, and the need for robust task generalization. Prompt-based methodologies have emerged as a pivotal strategy to guide deep learning models, providing flexible, domain-specific adaptations that significantly enhance model performance and adaptability without extensive retraining. This systematic review critically examines the burgeoning landscape of prompt engineering in medical imaging. We dissect diverse prompt modalities, including textual instructions, visual prompts, and learnable embeddings, and analyze their integration for core tasks such as image generation, segmentation, and classification. Our synthesis reveals how these mechanisms improve task-specific outcomes by enhancing accuracy, robustness, and data efficiency and reducing reliance on manual feature engineering while fostering greater model interpretability by making the model's guidance explicit. Despite substantial advancements, we identify persistent challenges, particularly in prompt design optimization, data heterogeneity, and ensuring scalability for clinical deployment. Finally, this review outlines promising future trajectories, including advanced multimodal prompting and robust clinical integration, underscoring the critical role of prompt-driven AI in accelerating the revolution of diagnostics and personalized treatment planning in medicine.
format Preprint
id arxiv_https___arxiv_org_abs_2507_01055
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Prompt Mechanisms in Medical Imaging: A Comprehensive Survey
Yang, Hao
Liang, Xinlong
Li, Zhang
Sun, Yue
Hu, Zheyu
Xie, Xinghe
Dashtbozorg, Behdad
Huang, Jincheng
Zhu, Shiwei
Han, Luyi
Zhang, Jiong
Wang, Shanshan
Mann, Ritse
Yu, Qifeng
Tan, Tao
Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Deep learning offers transformative potential in medical imaging, yet its clinical adoption is frequently hampered by challenges such as data scarcity, distribution shifts, and the need for robust task generalization. Prompt-based methodologies have emerged as a pivotal strategy to guide deep learning models, providing flexible, domain-specific adaptations that significantly enhance model performance and adaptability without extensive retraining. This systematic review critically examines the burgeoning landscape of prompt engineering in medical imaging. We dissect diverse prompt modalities, including textual instructions, visual prompts, and learnable embeddings, and analyze their integration for core tasks such as image generation, segmentation, and classification. Our synthesis reveals how these mechanisms improve task-specific outcomes by enhancing accuracy, robustness, and data efficiency and reducing reliance on manual feature engineering while fostering greater model interpretability by making the model's guidance explicit. Despite substantial advancements, we identify persistent challenges, particularly in prompt design optimization, data heterogeneity, and ensuring scalability for clinical deployment. Finally, this review outlines promising future trajectories, including advanced multimodal prompting and robust clinical integration, underscoring the critical role of prompt-driven AI in accelerating the revolution of diagnostics and personalized treatment planning in medicine.
title Prompt Mechanisms in Medical Imaging: A Comprehensive Survey
topic Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.01055