A Comparative Study of Machine Learning and Deep Learning for Out-of-Distribution Detection

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Baek, Jihyeon, Lee, Seunghoon, Kwon, Gitaek, Park, Doohyun
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914581246377984
author Baek, Jihyeon
Lee, Seunghoon
Kwon, Gitaek
Park, Doohyun
author_facet Baek, Jihyeon
Lee, Seunghoon
Kwon, Gitaek
Park, Doohyun
contents Out-of-distribution (OOD) detection is essential for building reliable AI systems, as models that produce outputs for invalid inputs cannot be trusted. Although deep learning (DL) is often assumed to outperform traditional machine learning (ML), medical imaging data are typically acquired under standardized protocols, leading to relatively constrained image variability in OOD detection tasks. This motivates a direct comparison between ML and DL approaches in this setting. The two approaches are evaluated on open datasets comprising over 60,000 fundus and non-fundus images across multiple resolutions. Both approaches achieved an AUROC of 1.000 and accuracies between 0.999 and 1.000 on internal and external validation sets, showing comparable detection performance. The ML approach, however, exhibited substantially lower end-to-end latency while maintaining equivalent accuracy, indicating greater computational efficiency. These results suggest that for OOD detection tasks of limited visual complexity, lightweight ML approaches can achieve DL-level performance with significantly reduced computational cost, supporting practical real-world deployment.
format Preprint
id arxiv_https___arxiv_org_abs_2605_10181
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle A Comparative Study of Machine Learning and Deep Learning for Out-of-Distribution Detection
Baek, Jihyeon
Lee, Seunghoon
Kwon, Gitaek
Park, Doohyun
Computer Vision and Pattern Recognition
Artificial Intelligence
Out-of-distribution (OOD) detection is essential for building reliable AI systems, as models that produce outputs for invalid inputs cannot be trusted. Although deep learning (DL) is often assumed to outperform traditional machine learning (ML), medical imaging data are typically acquired under standardized protocols, leading to relatively constrained image variability in OOD detection tasks. This motivates a direct comparison between ML and DL approaches in this setting. The two approaches are evaluated on open datasets comprising over 60,000 fundus and non-fundus images across multiple resolutions. Both approaches achieved an AUROC of 1.000 and accuracies between 0.999 and 1.000 on internal and external validation sets, showing comparable detection performance. The ML approach, however, exhibited substantially lower end-to-end latency while maintaining equivalent accuracy, indicating greater computational efficiency. These results suggest that for OOD detection tasks of limited visual complexity, lightweight ML approaches can achieve DL-level performance with significantly reduced computational cost, supporting practical real-world deployment.
title A Comparative Study of Machine Learning and Deep Learning for Out-of-Distribution Detection
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2605.10181