Beyond accuracy: quantifying the reliability of Multiple Instance Learning for Whole Slide Image classification
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915661556482048 |
|---|---|
| author | Keshvarikhojasteh, Hassan Aubreville, Marc Bertram, Christof A. Pluim, Josien P. W. Veta, Mitko |
| author_facet | Keshvarikhojasteh, Hassan Aubreville, Marc Bertram, Christof A. Pluim, Josien P. W. Veta, Mitko |
| contents | Machine learning models have become integral to many fields, but their reliability, defined as producing dependable, trustworthy, and domain-consistent predictions, remains a critical concern. Multiple Instance Learning (MIL) models designed for Whole Slide Image (WSI) classification in computational pathology are rarely evaluated in terms of reliability, leaving a key gap in understanding their suitability for high-stakes applications like clinical decision-making. In this paper, we address this gap by introducing three quantitative metrics for reliability assessment and applying them to several widely used MIL architectures across three region-wise annotated pathology datasets. Our findings indicate that the mean pooling instance (MEAN-POOL-INS)model demonstrates superior reliability compared to other networks, despite its simple architectural design and computational efficiency. These findings underscore the need of reliability evaluation alongside predictive performance in MIL models and establish MEAN-POOL-INS as a strong, trustworthy baseline for future research. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_11110 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Beyond accuracy: quantifying the reliability of Multiple Instance Learning for Whole Slide Image classification Keshvarikhojasteh, Hassan Aubreville, Marc Bertram, Christof A. Pluim, Josien P. W. Veta, Mitko Computer Vision and Pattern Recognition Machine learning models have become integral to many fields, but their reliability, defined as producing dependable, trustworthy, and domain-consistent predictions, remains a critical concern. Multiple Instance Learning (MIL) models designed for Whole Slide Image (WSI) classification in computational pathology are rarely evaluated in terms of reliability, leaving a key gap in understanding their suitability for high-stakes applications like clinical decision-making. In this paper, we address this gap by introducing three quantitative metrics for reliability assessment and applying them to several widely used MIL architectures across three region-wise annotated pathology datasets. Our findings indicate that the mean pooling instance (MEAN-POOL-INS)model demonstrates superior reliability compared to other networks, despite its simple architectural design and computational efficiency. These findings underscore the need of reliability evaluation alongside predictive performance in MIL models and establish MEAN-POOL-INS as a strong, trustworthy baseline for future research. |
| title | Beyond accuracy: quantifying the reliability of Multiple Instance Learning for Whole Slide Image classification |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2409.11110 |