Into the Fog: Evaluating Robustness of Multiple Object Tracking

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kirillova, Nadezda, Mirza, M. Jehanzeb, Bischof, Horst, Possegger, Horst
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912118015524864
author Kirillova, Nadezda
Mirza, M. Jehanzeb
Bischof, Horst
Possegger, Horst
author_facet Kirillova, Nadezda
Mirza, M. Jehanzeb
Bischof, Horst
Possegger, Horst
contents State-of-the-art Multiple Object Tracking (MOT) approaches have shown remarkable performance when trained and evaluated on current benchmarks. However, these benchmarks primarily consist of clear weather scenarios, overlooking adverse atmospheric conditions such as fog, haze, smoke and dust. As a result, the robustness of trackers against these challenging conditions remains underexplored. To address this gap, we introduce physics-based volumetric fog simulation method for arbitrary MOT datasets, utilizing frame-by-frame monocular depth estimation and a fog formation optical model. We enhance our simulation by rendering both homogeneous and heterogeneous fog and propose to use the dark channel prior method to estimate atmospheric light, showing promising results even in night and indoor scenes. We present the leading benchmark MOTChallenge (third release) augmented with fog (smoke for indoor scenes) of various intensities and conduct a comprehensive evaluation of MOT methods, revealing their limitations under fog and fog-like challenges.
format Preprint
id arxiv_https___arxiv_org_abs_2404_10534
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Into the Fog: Evaluating Robustness of Multiple Object Tracking
Kirillova, Nadezda
Mirza, M. Jehanzeb
Bischof, Horst
Possegger, Horst
Computer Vision and Pattern Recognition
Artificial Intelligence
State-of-the-art Multiple Object Tracking (MOT) approaches have shown remarkable performance when trained and evaluated on current benchmarks. However, these benchmarks primarily consist of clear weather scenarios, overlooking adverse atmospheric conditions such as fog, haze, smoke and dust. As a result, the robustness of trackers against these challenging conditions remains underexplored. To address this gap, we introduce physics-based volumetric fog simulation method for arbitrary MOT datasets, utilizing frame-by-frame monocular depth estimation and a fog formation optical model. We enhance our simulation by rendering both homogeneous and heterogeneous fog and propose to use the dark channel prior method to estimate atmospheric light, showing promising results even in night and indoor scenes. We present the leading benchmark MOTChallenge (third release) augmented with fog (smoke for indoor scenes) of various intensities and conduct a comprehensive evaluation of MOT methods, revealing their limitations under fog and fog-like challenges.
title Into the Fog: Evaluating Robustness of Multiple Object Tracking
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2404.10534