An Assessment of Human vs. Model Uncertainty in Soft-Label Learning and Calibration

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Pavlovic, Maja, Paun, Silviu, Poesio, Massimo
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910232856231936
author Pavlovic, Maja
Paun, Silviu
Poesio, Massimo
author_facet Pavlovic, Maja
Paun, Silviu
Poesio, Massimo
contents Central to human-aligned AI is understanding the benefits of human-elicited labels over synthetic alternatives. While human soft-labels improve calibration by capturing uncertainty, prior studies conflate these benefits with the implicit correction of mislabeled data (mode shifts), obscuring true effects of soft-labels. We present a controlled audit of soft-label learning across MNIST and a synthetic variant, re-annotating subsets to extract human uncertainty. By decoupling soft-label supervision from underlying label mode shifts, we show that while human soft-labels do provide accuracy gains, their larger value lies in acting as a regularizer that improves model calibration on difficult samples and promotes stable convergence across training runs. Dataset cartography reveals models trained on human soft-labels mirror human uncertainty, whereas those trained on synthetic labels fail to align with humans. Broadly, this work provides a diagnostic testbed for human-AI uncertainty alignment.
format Preprint
id arxiv_https___arxiv_org_abs_2605_18648
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle An Assessment of Human vs. Model Uncertainty in Soft-Label Learning and Calibration
Pavlovic, Maja
Paun, Silviu
Poesio, Massimo
Machine Learning
Artificial Intelligence
Computation and Language
Central to human-aligned AI is understanding the benefits of human-elicited labels over synthetic alternatives. While human soft-labels improve calibration by capturing uncertainty, prior studies conflate these benefits with the implicit correction of mislabeled data (mode shifts), obscuring true effects of soft-labels. We present a controlled audit of soft-label learning across MNIST and a synthetic variant, re-annotating subsets to extract human uncertainty. By decoupling soft-label supervision from underlying label mode shifts, we show that while human soft-labels do provide accuracy gains, their larger value lies in acting as a regularizer that improves model calibration on difficult samples and promotes stable convergence across training runs. Dataset cartography reveals models trained on human soft-labels mirror human uncertainty, whereas those trained on synthetic labels fail to align with humans. Broadly, this work provides a diagnostic testbed for human-AI uncertainty alignment.
title An Assessment of Human vs. Model Uncertainty in Soft-Label Learning and Calibration
topic Machine Learning
Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2605.18648