Revisiting the Evaluation of Deep Neural Networks for Pedestrian Detection

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Feifel, Patrick, Franke, Benedikt, Bonarens, Frank, Köster, Frank, Raulf, Arne, Schwenker, Friedhelm
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915773572710400
author Feifel, Patrick
Franke, Benedikt
Bonarens, Frank
Köster, Frank
Raulf, Arne
Schwenker, Friedhelm
author_facet Feifel, Patrick
Franke, Benedikt
Bonarens, Frank
Köster, Frank
Raulf, Arne
Schwenker, Friedhelm
contents Reliable pedestrian detection represents a crucial step towards automated driving systems. However, the current performance benchmarks exhibit weaknesses. The currently applied metrics for various subsets of a validation dataset prohibit a realistic performance evaluation of a DNN for pedestrian detection. As image segmentation supplies fine-grained information about a street scene, it can serve as a starting point to automatically distinguish between different types of errors during the evaluation of a pedestrian detector. In this work, eight different error categories for pedestrian detection are proposed and new metrics are proposed for performance comparison along these error categories. We use the new metrics to compare various backbones for a simplified version of the APD, and show a more fine-grained and robust way to compare models with each other especially in terms of safety-critical performance. We achieve SOTA on CityPersons-reasonable (without extra training data) by using a rather simple architecture.
format Preprint
id arxiv_https___arxiv_org_abs_2511_10308
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Revisiting the Evaluation of Deep Neural Networks for Pedestrian Detection
Feifel, Patrick
Franke, Benedikt
Bonarens, Frank
Köster, Frank
Raulf, Arne
Schwenker, Friedhelm
Computer Vision and Pattern Recognition
Machine Learning
Reliable pedestrian detection represents a crucial step towards automated driving systems. However, the current performance benchmarks exhibit weaknesses. The currently applied metrics for various subsets of a validation dataset prohibit a realistic performance evaluation of a DNN for pedestrian detection. As image segmentation supplies fine-grained information about a street scene, it can serve as a starting point to automatically distinguish between different types of errors during the evaluation of a pedestrian detector. In this work, eight different error categories for pedestrian detection are proposed and new metrics are proposed for performance comparison along these error categories. We use the new metrics to compare various backbones for a simplified version of the APD, and show a more fine-grained and robust way to compare models with each other especially in terms of safety-critical performance. We achieve SOTA on CityPersons-reasonable (without extra training data) by using a rather simple architecture.
title Revisiting the Evaluation of Deep Neural Networks for Pedestrian Detection
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2511.10308