Dimensionality Reduction and Nearest Neighbors for Improving Out-of-Distribution Detection in Medical Image Segmentation

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Woodland, McKell, Patel, Nihil, Castelo, Austin, Taie, Mais Al, Eltaher, Mohamed, Yung, Joshua P., Netherton, Tucker J., Calderone, Tiffany L., Sanchez, Jessica I., Cleere, Darrel W., Elsaiey, Ahmed, Gupta, Nakul, Victor, David, Beretta, Laura, Patel, Ankit B., Brock, Kristy K.
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914962239127552
author Woodland, McKell
Patel, Nihil
Castelo, Austin
Taie, Mais Al
Eltaher, Mohamed
Yung, Joshua P.
Netherton, Tucker J.
Calderone, Tiffany L.
Sanchez, Jessica I.
Cleere, Darrel W.
Elsaiey, Ahmed
Gupta, Nakul
Victor, David
Beretta, Laura
Patel, Ankit B.
Brock, Kristy K.
author_facet Woodland, McKell
Patel, Nihil
Castelo, Austin
Taie, Mais Al
Eltaher, Mohamed
Yung, Joshua P.
Netherton, Tucker J.
Calderone, Tiffany L.
Sanchez, Jessica I.
Cleere, Darrel W.
Elsaiey, Ahmed
Gupta, Nakul
Victor, David
Beretta, Laura
Patel, Ankit B.
Brock, Kristy K.
contents Clinically deployed deep learning-based segmentation models are known to fail on data outside of their training distributions. While clinicians review the segmentations, these models tend to perform well in most instances, which could exacerbate automation bias. Therefore, detecting out-of-distribution images at inference is critical to warn the clinicians that the model likely failed. This work applied the Mahalanobis distance (MD) post hoc to the bottleneck features of four Swin UNETR and nnU-net models that segmented the liver on T1-weighted magnetic resonance imaging and computed tomography. By reducing the dimensions of the bottleneck features with either principal component analysis or uniform manifold approximation and projection, images the models failed on were detected with high performance and minimal computational load. In addition, this work explored a non-parametric alternative to the MD, a k-th nearest neighbors distance (KNN). KNN drastically improved scalability and performance over MD when both were applied to raw and average-pooled bottleneck features.
format Preprint
id arxiv_https___arxiv_org_abs_2408_02761
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Dimensionality Reduction and Nearest Neighbors for Improving Out-of-Distribution Detection in Medical Image Segmentation
Woodland, McKell
Patel, Nihil
Castelo, Austin
Taie, Mais Al
Eltaher, Mohamed
Yung, Joshua P.
Netherton, Tucker J.
Calderone, Tiffany L.
Sanchez, Jessica I.
Cleere, Darrel W.
Elsaiey, Ahmed
Gupta, Nakul
Victor, David
Beretta, Laura
Patel, Ankit B.
Brock, Kristy K.
Computer Vision and Pattern Recognition
Machine Learning
Clinically deployed deep learning-based segmentation models are known to fail on data outside of their training distributions. While clinicians review the segmentations, these models tend to perform well in most instances, which could exacerbate automation bias. Therefore, detecting out-of-distribution images at inference is critical to warn the clinicians that the model likely failed. This work applied the Mahalanobis distance (MD) post hoc to the bottleneck features of four Swin UNETR and nnU-net models that segmented the liver on T1-weighted magnetic resonance imaging and computed tomography. By reducing the dimensions of the bottleneck features with either principal component analysis or uniform manifold approximation and projection, images the models failed on were detected with high performance and minimal computational load. In addition, this work explored a non-parametric alternative to the MD, a k-th nearest neighbors distance (KNN). KNN drastically improved scalability and performance over MD when both were applied to raw and average-pooled bottleneck features.
title Dimensionality Reduction and Nearest Neighbors for Improving Out-of-Distribution Detection in Medical Image Segmentation
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2408.02761