Estimation of Confidence Bounds in Binary Classification using Wilson Score Kernel Density Estimation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Iversen, Thorbjørn Mosekjær, Duan, Zebin, Hagelskjær, Frederik
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866917291796463616
author Iversen, Thorbjørn Mosekjær
Duan, Zebin
Hagelskjær, Frederik
author_facet Iversen, Thorbjørn Mosekjær
Duan, Zebin
Hagelskjær, Frederik
contents The performance and ease of use of deep learning-based binary classifiers have improved significantly in recent years. This has opened up the potential for automating critical inspection tasks, which have traditionally only been trusted to be done manually. However, the application of binary classifiers in critical operations depends on the estimation of reliable confidence bounds such that system performance can be ensured up to a given statistical significance. We present Wilson Score Kernel Density Classification, which is a novel kernel-based method for estimating confidence bounds in binary classification. The core of our method is the Wilson Score Kernel Density Estimator, which is a function estimator for estimating confidence bounds in Binomial experiments with conditionally varying success probabilities. Our method is evaluated in the context of selective classification on four different datasets, illustrating its use as a classification head of any feature extractor, including vision foundation models. Our proposed method shows similar performance to Gaussian Process Classification, but at a lower computational complexity.
format Preprint
id arxiv_https___arxiv_org_abs_2602_20947
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Estimation of Confidence Bounds in Binary Classification using Wilson Score Kernel Density Estimation
Iversen, Thorbjørn Mosekjær
Duan, Zebin
Hagelskjær, Frederik
Machine Learning
Computer Vision and Pattern Recognition
The performance and ease of use of deep learning-based binary classifiers have improved significantly in recent years. This has opened up the potential for automating critical inspection tasks, which have traditionally only been trusted to be done manually. However, the application of binary classifiers in critical operations depends on the estimation of reliable confidence bounds such that system performance can be ensured up to a given statistical significance. We present Wilson Score Kernel Density Classification, which is a novel kernel-based method for estimating confidence bounds in binary classification. The core of our method is the Wilson Score Kernel Density Estimator, which is a function estimator for estimating confidence bounds in Binomial experiments with conditionally varying success probabilities. Our method is evaluated in the context of selective classification on four different datasets, illustrating its use as a classification head of any feature extractor, including vision foundation models. Our proposed method shows similar performance to Gaussian Process Classification, but at a lower computational complexity.
title Estimation of Confidence Bounds in Binary Classification using Wilson Score Kernel Density Estimation
topic Machine Learning
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2602.20947