Coupling AI and Citizen Science in Creation of Enhanced Training Dataset for Medical Image Segmentation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Syahmi, Amir, Lu, Xiangrong, Li, Yinxuan, Yao, Haoxuan, Jiang, Hanjun, Acharya, Ishita, Wang, Shiyi, Nan, Yang, Xing, Xiaodan, Yang, Guang
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915399104200704
author Syahmi, Amir
Lu, Xiangrong
Li, Yinxuan
Yao, Haoxuan
Jiang, Hanjun
Acharya, Ishita
Wang, Shiyi
Nan, Yang
Xing, Xiaodan
Yang, Guang
author_facet Syahmi, Amir
Lu, Xiangrong
Li, Yinxuan
Yao, Haoxuan
Jiang, Hanjun
Acharya, Ishita
Wang, Shiyi
Nan, Yang
Xing, Xiaodan
Yang, Guang
contents Recent advancements in medical imaging and artificial intelligence (AI) have greatly enhanced diagnostic capabilities, but the development of effective deep learning (DL) models is still constrained by the lack of high-quality annotated datasets. The traditional manual annotation process by medical experts is time- and resource-intensive, limiting the scalability of these datasets. In this work, we introduce a robust and versatile framework that combines AI and crowdsourcing to improve both the quality and quantity of medical image datasets across different modalities. Our approach utilises a user-friendly online platform that enables a diverse group of crowd annotators to label medical images efficiently. By integrating the MedSAM segmentation AI with this platform, we accelerate the annotation process while maintaining expert-level quality through an algorithm that merges crowd-labelled images. Additionally, we employ pix2pixGAN, a generative AI model, to expand the training dataset with synthetic images that capture realistic morphological features. These methods are combined into a cohesive framework designed to produce an enhanced dataset, which can serve as a universal pre-processing pipeline to boost the training of any medical deep learning segmentation model. Our results demonstrate that this framework significantly improves model performance, especially when training data is limited.
format Preprint
id arxiv_https___arxiv_org_abs_2409_03087
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Coupling AI and Citizen Science in Creation of Enhanced Training Dataset for Medical Image Segmentation
Syahmi, Amir
Lu, Xiangrong
Li, Yinxuan
Yao, Haoxuan
Jiang, Hanjun
Acharya, Ishita
Wang, Shiyi
Nan, Yang
Xing, Xiaodan
Yang, Guang
Image and Video Processing
Computer Vision and Pattern Recognition
Recent advancements in medical imaging and artificial intelligence (AI) have greatly enhanced diagnostic capabilities, but the development of effective deep learning (DL) models is still constrained by the lack of high-quality annotated datasets. The traditional manual annotation process by medical experts is time- and resource-intensive, limiting the scalability of these datasets. In this work, we introduce a robust and versatile framework that combines AI and crowdsourcing to improve both the quality and quantity of medical image datasets across different modalities. Our approach utilises a user-friendly online platform that enables a diverse group of crowd annotators to label medical images efficiently. By integrating the MedSAM segmentation AI with this platform, we accelerate the annotation process while maintaining expert-level quality through an algorithm that merges crowd-labelled images. Additionally, we employ pix2pixGAN, a generative AI model, to expand the training dataset with synthetic images that capture realistic morphological features. These methods are combined into a cohesive framework designed to produce an enhanced dataset, which can serve as a universal pre-processing pipeline to boost the training of any medical deep learning segmentation model. Our results demonstrate that this framework significantly improves model performance, especially when training data is limited.
title Coupling AI and Citizen Science in Creation of Enhanced Training Dataset for Medical Image Segmentation
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2409.03087