Fairness in Autonomous Driving: Towards Understanding Confounding Factors in Object Detection under Challenging Weather

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Pathiraja, Bimsara, Liu, Caleb, Senanayake, Ransalu
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916269226196992
author Pathiraja, Bimsara
Liu, Caleb
Senanayake, Ransalu
author_facet Pathiraja, Bimsara
Liu, Caleb
Senanayake, Ransalu
contents The deployment of autonomous vehicles (AVs) is rapidly expanding to numerous cities. At the heart of AVs, the object detection module assumes a paramount role, directly influencing all downstream decision-making tasks by considering the presence of nearby pedestrians, vehicles, and more. Despite high accuracy of pedestrians detected on held-out datasets, the potential presence of algorithmic bias in such object detectors, particularly in challenging weather conditions, remains unclear. This study provides a comprehensive empirical analysis of fairness in detecting pedestrians in a state-of-the-art transformer-based object detector. In addition to classical metrics, we introduce novel probability-based metrics to measure various intricate properties of object detection. Leveraging the state-of-the-art FACET dataset and the Carla high-fidelity vehicle simulator, our analysis explores the effect of protected attributes such as gender, skin tone, and body size on object detection performance in varying environmental conditions such as ambient darkness and fog. Our quantitative analysis reveals how the previously overlooked yet intuitive factors, such as the distribution of demographic groups in the scene, the severity of weather, the pedestrians' proximity to the AV, among others, affect object detection performance. Our code is available at https://github.com/bimsarapathiraja/fair-AV.
format Preprint
id arxiv_https___arxiv_org_abs_2406_00219
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Fairness in Autonomous Driving: Towards Understanding Confounding Factors in Object Detection under Challenging Weather
Pathiraja, Bimsara
Liu, Caleb
Senanayake, Ransalu
Computer Vision and Pattern Recognition
The deployment of autonomous vehicles (AVs) is rapidly expanding to numerous cities. At the heart of AVs, the object detection module assumes a paramount role, directly influencing all downstream decision-making tasks by considering the presence of nearby pedestrians, vehicles, and more. Despite high accuracy of pedestrians detected on held-out datasets, the potential presence of algorithmic bias in such object detectors, particularly in challenging weather conditions, remains unclear. This study provides a comprehensive empirical analysis of fairness in detecting pedestrians in a state-of-the-art transformer-based object detector. In addition to classical metrics, we introduce novel probability-based metrics to measure various intricate properties of object detection. Leveraging the state-of-the-art FACET dataset and the Carla high-fidelity vehicle simulator, our analysis explores the effect of protected attributes such as gender, skin tone, and body size on object detection performance in varying environmental conditions such as ambient darkness and fog. Our quantitative analysis reveals how the previously overlooked yet intuitive factors, such as the distribution of demographic groups in the scene, the severity of weather, the pedestrians' proximity to the AV, among others, affect object detection performance. Our code is available at https://github.com/bimsarapathiraja/fair-AV.
title Fairness in Autonomous Driving: Towards Understanding Confounding Factors in Object Detection under Challenging Weather
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2406.00219