From Model Uncertainty to Human Attention: Localization-Aware Visual Cues for Scalable Annotation Review
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914559718064128 |
|---|---|
| author | Sbeyti, Moussa Kassem Holstein, Joshua Spitzer, Philipp Klein, Nadja Satzger, Gerhard |
| author_facet | Sbeyti, Moussa Kassem Holstein, Joshua Spitzer, Philipp Klein, Nadja Satzger, Gerhard |
| contents | High-quality labeled data is essential for training robust machine learning models, yet obtaining annotations at scale remains expensive. AI-assisted annotation has therefore become standard in large-scale labeling workflows. However, in tasks where model predictions carry two independent components, a class label and spatial boundaries, a model may classify an object with high confidence while mislocalizing it. Existing AI-assisted workflows offer annotators no signal about where spatial errors are most likely. Without such guidance, humans may systematically underinspect subtly misplaced boxes. We address this by studying the effect of visualizing spatial uncertainty via a purpose-built interface. In a controlled study with 120 participants, those receiving uncertainty cues achieve higher label quality while being faster overall. A box-level analysis confirms that the cues redirect annotator effort toward high-uncertainty predictions and away from well-localized boxes. These findings establish localization uncertainty as a lever to improve human-in-the-loop annotation. Code is available at https://mos-ks.github.io/MUHA/. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2605_12303 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | From Model Uncertainty to Human Attention: Localization-Aware Visual Cues for Scalable Annotation Review Sbeyti, Moussa Kassem Holstein, Joshua Spitzer, Philipp Klein, Nadja Satzger, Gerhard Human-Computer Interaction Computer Vision and Pattern Recognition Machine Learning High-quality labeled data is essential for training robust machine learning models, yet obtaining annotations at scale remains expensive. AI-assisted annotation has therefore become standard in large-scale labeling workflows. However, in tasks where model predictions carry two independent components, a class label and spatial boundaries, a model may classify an object with high confidence while mislocalizing it. Existing AI-assisted workflows offer annotators no signal about where spatial errors are most likely. Without such guidance, humans may systematically underinspect subtly misplaced boxes. We address this by studying the effect of visualizing spatial uncertainty via a purpose-built interface. In a controlled study with 120 participants, those receiving uncertainty cues achieve higher label quality while being faster overall. A box-level analysis confirms that the cues redirect annotator effort toward high-uncertainty predictions and away from well-localized boxes. These findings establish localization uncertainty as a lever to improve human-in-the-loop annotation. Code is available at https://mos-ks.github.io/MUHA/. |
| title | From Model Uncertainty to Human Attention: Localization-Aware Visual Cues for Scalable Annotation Review |
| topic | Human-Computer Interaction Computer Vision and Pattern Recognition Machine Learning |
| url | https://arxiv.org/abs/2605.12303 |