Automatic Labels are as Effective as Manual Labels in Biomedical Images Classification with Deep Learning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Marini, Niccolò, Marchesin, Stefano, Ferris, Lluis Borras, Püttmann, Simon, Wodzinski, Marek, Fratti, Riccardo, Podareanu, Damian, Caputo, Alessandro, Boytcheva, Svetla, Vatrano, Simona, Fraggetta, Filippo, Nagtegaal, Iris, Silvello, Gianmaria, Atzori, Manfredo, Müller, Henning
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909228155797504
author Marini, Niccolò
Marchesin, Stefano
Ferris, Lluis Borras
Püttmann, Simon
Wodzinski, Marek
Fratti, Riccardo
Podareanu, Damian
Caputo, Alessandro
Boytcheva, Svetla
Vatrano, Simona
Fraggetta, Filippo
Nagtegaal, Iris
Silvello, Gianmaria
Atzori, Manfredo
Müller, Henning
author_facet Marini, Niccolò
Marchesin, Stefano
Ferris, Lluis Borras
Püttmann, Simon
Wodzinski, Marek
Fratti, Riccardo
Podareanu, Damian
Caputo, Alessandro
Boytcheva, Svetla
Vatrano, Simona
Fraggetta, Filippo
Nagtegaal, Iris
Silvello, Gianmaria
Atzori, Manfredo
Müller, Henning
contents The increasing availability of biomedical data is helping to design more robust deep learning (DL) algorithms to analyze biomedical samples. Currently, one of the main limitations to train DL algorithms to perform a specific task is the need for medical experts to label data. Automatic methods to label data exist, however automatic labels can be noisy and it is not completely clear when automatic labels can be adopted to train DL models. This paper aims to investigate under which circumstances automatic labels can be adopted to train a DL model on the classification of Whole Slide Images (WSI). The analysis involves multiple architectures, such as Convolutional Neural Networks (CNN) and Vision Transformer (ViT), and over 10000 WSIs, collected from three use cases: celiac disease, lung cancer and colon cancer, which one including respectively binary, multiclass and multilabel data. The results allow identifying 10% as the percentage of noisy labels that lead to train competitive models for the classification of WSIs. Therefore, an algorithm generating automatic labels needs to fit this criterion to be adopted. The application of the Semantic Knowledge Extractor Tool (SKET) algorithm to generate automatic labels leads to performance comparable to the one obtained with manual labels, since it generates a percentage of noisy labels between 2-5%. Automatic labels are as effective as manual ones, reaching solid performance comparable to the one obtained training models with manual labels.
format Preprint
id arxiv_https___arxiv_org_abs_2406_14351
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Automatic Labels are as Effective as Manual Labels in Biomedical Images Classification with Deep Learning
Marini, Niccolò
Marchesin, Stefano
Ferris, Lluis Borras
Püttmann, Simon
Wodzinski, Marek
Fratti, Riccardo
Podareanu, Damian
Caputo, Alessandro
Boytcheva, Svetla
Vatrano, Simona
Fraggetta, Filippo
Nagtegaal, Iris
Silvello, Gianmaria
Atzori, Manfredo
Müller, Henning
Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
The increasing availability of biomedical data is helping to design more robust deep learning (DL) algorithms to analyze biomedical samples. Currently, one of the main limitations to train DL algorithms to perform a specific task is the need for medical experts to label data. Automatic methods to label data exist, however automatic labels can be noisy and it is not completely clear when automatic labels can be adopted to train DL models. This paper aims to investigate under which circumstances automatic labels can be adopted to train a DL model on the classification of Whole Slide Images (WSI). The analysis involves multiple architectures, such as Convolutional Neural Networks (CNN) and Vision Transformer (ViT), and over 10000 WSIs, collected from three use cases: celiac disease, lung cancer and colon cancer, which one including respectively binary, multiclass and multilabel data. The results allow identifying 10% as the percentage of noisy labels that lead to train competitive models for the classification of WSIs. Therefore, an algorithm generating automatic labels needs to fit this criterion to be adopted. The application of the Semantic Knowledge Extractor Tool (SKET) algorithm to generate automatic labels leads to performance comparable to the one obtained with manual labels, since it generates a percentage of noisy labels between 2-5%. Automatic labels are as effective as manual ones, reaching solid performance comparable to the one obtained training models with manual labels.
title Automatic Labels are as Effective as Manual Labels in Biomedical Images Classification with Deep Learning
topic Image and Video Processing
Artificial Intelligence
Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2406.14351