Efficient Quantization-Aware Training on Segment Anything Model in Medical Images and Its Deployment

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Lu, Haisheng, Fu, Yujie, Zhang, Fan, Zhang, Le
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912158051205120
author Lu, Haisheng
Fu, Yujie
Zhang, Fan
Zhang, Le
author_facet Lu, Haisheng
Fu, Yujie
Zhang, Fan
Zhang, Le
contents Medical image segmentation is a critical component of clinical practice, and the state-of-the-art MedSAM model has significantly advanced this field. Nevertheless, critiques highlight that MedSAM demands substantial computational resources during inference. To address this issue, the CVPR 2024 MedSAM on Laptop Challenge was established to find an optimal balance between accuracy and processing speed. In this paper, we introduce a quantization-aware training pipeline designed to efficiently quantize the Segment Anything Model for medical images and deploy it using the OpenVINO inference engine. This pipeline optimizes both training time and disk storage. Our experimental results confirm that this approach considerably enhances processing speed over the baseline, while still achieving an acceptable accuracy level. The training script, inference script, and quantized model are publicly accessible at https://github.com/AVC2-UESTC/QMedSAM.
format Preprint
id arxiv_https___arxiv_org_abs_2412_11186
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Efficient Quantization-Aware Training on Segment Anything Model in Medical Images and Its Deployment
Lu, Haisheng
Fu, Yujie
Zhang, Fan
Zhang, Le
Computer Vision and Pattern Recognition
Artificial Intelligence
Medical image segmentation is a critical component of clinical practice, and the state-of-the-art MedSAM model has significantly advanced this field. Nevertheless, critiques highlight that MedSAM demands substantial computational resources during inference. To address this issue, the CVPR 2024 MedSAM on Laptop Challenge was established to find an optimal balance between accuracy and processing speed. In this paper, we introduce a quantization-aware training pipeline designed to efficiently quantize the Segment Anything Model for medical images and deploy it using the OpenVINO inference engine. This pipeline optimizes both training time and disk storage. Our experimental results confirm that this approach considerably enhances processing speed over the baseline, while still achieving an acceptable accuracy level. The training script, inference script, and quantized model are publicly accessible at https://github.com/AVC2-UESTC/QMedSAM.
title Efficient Quantization-Aware Training on Segment Anything Model in Medical Images and Its Deployment
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2412.11186