Optimizing the image correction pipeline for pedestrian detection in the thermal-infrared domain

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Karam, Christophe, Matias, Jessy, Breniere, Xavier, Chanussot, Jocelyn
Format: Preprint
Veröffentlicht: 2024
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866929410505965568
author Karam, Christophe
Matias, Jessy
Breniere, Xavier
Chanussot, Jocelyn
author_facet Karam, Christophe
Matias, Jessy
Breniere, Xavier
Chanussot, Jocelyn
contents Infrared imagery can help in low-visibility situations such as fog and low-light scenarios, but it is prone to thermal noise and requires further processing and correction. This work studies the effect of different infrared processing pipelines on the performance of a pedestrian detection in an urban environment, similar to autonomous driving scenarios. Detection on infrared images is shown to outperform that on visible images, but the infrared correction pipeline is crucial since the models cannot extract information from raw infrared images. Two thermal correction pipelines are studied, the shutter and the shutterless pipes. Experiments show that some correction algorithms like spatial denoising are detrimental to performance even if they increase visual quality for a human observer. Other algorithms like destriping and, to a lesser extent, temporal denoising, increase computational time, but have some role to play in increasing detection accuracy. As it stands, the optimal trade-off for speed and accuracy is simply to use the shutterless pipe with a tonemapping algorithm only, for autonomous driving applications within varied environments.
format Preprint
id arxiv_https___arxiv_org_abs_2407_04484
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Optimizing the image correction pipeline for pedestrian detection in the thermal-infrared domain
Karam, Christophe
Matias, Jessy
Breniere, Xavier
Chanussot, Jocelyn
Computer Vision and Pattern Recognition
I.2.10; I.4.1; I.4.8; I.4.9
Infrared imagery can help in low-visibility situations such as fog and low-light scenarios, but it is prone to thermal noise and requires further processing and correction. This work studies the effect of different infrared processing pipelines on the performance of a pedestrian detection in an urban environment, similar to autonomous driving scenarios. Detection on infrared images is shown to outperform that on visible images, but the infrared correction pipeline is crucial since the models cannot extract information from raw infrared images. Two thermal correction pipelines are studied, the shutter and the shutterless pipes. Experiments show that some correction algorithms like spatial denoising are detrimental to performance even if they increase visual quality for a human observer. Other algorithms like destriping and, to a lesser extent, temporal denoising, increase computational time, but have some role to play in increasing detection accuracy. As it stands, the optimal trade-off for speed and accuracy is simply to use the shutterless pipe with a tonemapping algorithm only, for autonomous driving applications within varied environments.
title Optimizing the image correction pipeline for pedestrian detection in the thermal-infrared domain
topic Computer Vision and Pattern Recognition
I.2.10; I.4.1; I.4.8; I.4.9
url https://arxiv.org/abs/2407.04484