Saved in:
Bibliographic Details
Main Authors: Schneider, Helen, Nowak, Sebastian, Parikh, Aditya, Layer, Yannik C., Theis, Maike, Block, Wolfgang, Sprinkart, Alois M., Attenberger, Ulrike, Sifa, Rafet
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2410.21014
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912089835044864
author Schneider, Helen
Nowak, Sebastian
Parikh, Aditya
Layer, Yannik C.
Theis, Maike
Block, Wolfgang
Sprinkart, Alois M.
Attenberger, Ulrike
Sifa, Rafet
author_facet Schneider, Helen
Nowak, Sebastian
Parikh, Aditya
Layer, Yannik C.
Theis, Maike
Block, Wolfgang
Sprinkart, Alois M.
Attenberger, Ulrike
Sifa, Rafet
contents Image-based diagnostic decision support systems (DDSS) utilizing deep learning have the potential to optimize clinical workflows. However, developing DDSS requires extensive datasets with expert annotations and is therefore costly. Leveraging report contents from radiological data bases with Natural Language Processing to annotate the corresponding image data promises to replace labor-intensive manual annotation. As mining "real world" databases can introduce label noise, noise-robust training losses are of great interest. However, current noise-robust losses do not consider noise estimations that can for example be derived based on the performance of the automatic label generator used. In this study, we expand the noise-robust Deep Abstaining Classifier (DAC) loss to an Informed Deep Abstaining Classifier (IDAC) loss by incorporating noise level estimations during training. Our findings demonstrate that IDAC enhances the noise robustness compared to DAC and several state-of-the-art loss functions. The results are obtained on various simulated noise levels using a public chest X-ray data set. These findings are reproduced on an in-house noisy data set, where labels were extracted from the clinical systems of the University Hospital Bonn by a text-based transformer. The IDAC can therefore be a valuable tool for researchers, companies or clinics aiming to develop accurate and reliable DDSS from routine clinical data.
format Preprint
id arxiv_https___arxiv_org_abs_2410_21014
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Informed Deep Abstaining Classifier: Investigating noise-robust training for diagnostic decision support systems
Schneider, Helen
Nowak, Sebastian
Parikh, Aditya
Layer, Yannik C.
Theis, Maike
Block, Wolfgang
Sprinkart, Alois M.
Attenberger, Ulrike
Sifa, Rafet
Computer Vision and Pattern Recognition
Artificial Intelligence
Image-based diagnostic decision support systems (DDSS) utilizing deep learning have the potential to optimize clinical workflows. However, developing DDSS requires extensive datasets with expert annotations and is therefore costly. Leveraging report contents from radiological data bases with Natural Language Processing to annotate the corresponding image data promises to replace labor-intensive manual annotation. As mining "real world" databases can introduce label noise, noise-robust training losses are of great interest. However, current noise-robust losses do not consider noise estimations that can for example be derived based on the performance of the automatic label generator used. In this study, we expand the noise-robust Deep Abstaining Classifier (DAC) loss to an Informed Deep Abstaining Classifier (IDAC) loss by incorporating noise level estimations during training. Our findings demonstrate that IDAC enhances the noise robustness compared to DAC and several state-of-the-art loss functions. The results are obtained on various simulated noise levels using a public chest X-ray data set. These findings are reproduced on an in-house noisy data set, where labels were extracted from the clinical systems of the University Hospital Bonn by a text-based transformer. The IDAC can therefore be a valuable tool for researchers, companies or clinics aiming to develop accurate and reliable DDSS from routine clinical data.
title Informed Deep Abstaining Classifier: Investigating noise-robust training for diagnostic decision support systems
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2410.21014