Saved in:
Bibliographic Details
Main Authors: de Witte, Sven, Strafforello, Ombretta, van Gemert, Jan
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2401.17821
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910312490336256
author de Witte, Sven
Strafforello, Ombretta
van Gemert, Jan
author_facet de Witte, Sven
Strafforello, Ombretta
van Gemert, Jan
contents Bounding boxes are often used to communicate automatic object detection results to humans, aiding humans in a multitude of tasks. We investigate the relationship between bounding box localization errors and human task performance. We use observer performance studies on a visual multi-object counting task to measure both human trust and performance with different levels of bounding box accuracy. The results show that localization errors have no significant impact on human accuracy or trust in the system. Recall and precision errors impact both human performance and trust, suggesting that optimizing algorithms based on the F1 score is more beneficial in human-computer tasks. Lastly, the paper offers an improvement on bounding boxes in multi-object counting tasks with center dots, showing improved performance and better resilience to localization inaccuracy.
format Preprint
id arxiv_https___arxiv_org_abs_2401_17821
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Do Object Detection Localization Errors Affect Human Performance and Trust?
de Witte, Sven
Strafforello, Ombretta
van Gemert, Jan
Computer Vision and Pattern Recognition
Human-Computer Interaction
Bounding boxes are often used to communicate automatic object detection results to humans, aiding humans in a multitude of tasks. We investigate the relationship between bounding box localization errors and human task performance. We use observer performance studies on a visual multi-object counting task to measure both human trust and performance with different levels of bounding box accuracy. The results show that localization errors have no significant impact on human accuracy or trust in the system. Recall and precision errors impact both human performance and trust, suggesting that optimizing algorithms based on the F1 score is more beneficial in human-computer tasks. Lastly, the paper offers an improvement on bounding boxes in multi-object counting tasks with center dots, showing improved performance and better resilience to localization inaccuracy.
title Do Object Detection Localization Errors Affect Human Performance and Trust?
topic Computer Vision and Pattern Recognition
Human-Computer Interaction
url https://arxiv.org/abs/2401.17821