Spectrum-guided Feature Enhancement Network for Event Person Re-Identification

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Tan, Hongchen, Zhang, Yi, Liu, Xiuping, Yin, Baocai, Ma, Nan, Li, Xin, Lu, Huchuan
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913622273294336
author Tan, Hongchen
Zhang, Yi
Liu, Xiuping
Yin, Baocai
Ma, Nan
Li, Xin
Lu, Huchuan
author_facet Tan, Hongchen
Zhang, Yi
Liu, Xiuping
Yin, Baocai
Ma, Nan
Li, Xin
Lu, Huchuan
contents As a cutting-edge biosensor, the event camera holds significant potential in the field of computer vision, particularly regarding privacy preservation. However, compared to traditional cameras, event streams often contain noise and possess extremely sparse semantics, posing a formidable challenge for event-based person re-identification (event Re-ID). To address this, we introduce a novel event person re-identification network: the Spectrum-guided Feature Enhancement Network (SFE-Net). This network consists of two innovative components: the Multi-grain Spectrum Attention Mechanism (MSAM) and the Consecutive Patch Dropout Module (CPDM). MSAM employs a fourier spectrum transform strategy to filter event noise, while also utilizing an event-guided multi-granularity attention strategy to enhance and capture discriminative person semantics. CPDM employs a consecutive patch dropout strategy to generate multiple incomplete feature maps, encouraging the deep Re-ID model to equally perceive each effective region of the person's body and capture robust person descriptors. Extensive experiments on Event Re-ID datasets demonstrate that our SFE-Net achieves the best performance in this task.
format Preprint
id arxiv_https___arxiv_org_abs_2402_01269
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Spectrum-guided Feature Enhancement Network for Event Person Re-Identification
Tan, Hongchen
Zhang, Yi
Liu, Xiuping
Yin, Baocai
Ma, Nan
Li, Xin
Lu, Huchuan
Computer Vision and Pattern Recognition
As a cutting-edge biosensor, the event camera holds significant potential in the field of computer vision, particularly regarding privacy preservation. However, compared to traditional cameras, event streams often contain noise and possess extremely sparse semantics, posing a formidable challenge for event-based person re-identification (event Re-ID). To address this, we introduce a novel event person re-identification network: the Spectrum-guided Feature Enhancement Network (SFE-Net). This network consists of two innovative components: the Multi-grain Spectrum Attention Mechanism (MSAM) and the Consecutive Patch Dropout Module (CPDM). MSAM employs a fourier spectrum transform strategy to filter event noise, while also utilizing an event-guided multi-granularity attention strategy to enhance and capture discriminative person semantics. CPDM employs a consecutive patch dropout strategy to generate multiple incomplete feature maps, encouraging the deep Re-ID model to equally perceive each effective region of the person's body and capture robust person descriptors. Extensive experiments on Event Re-ID datasets demonstrate that our SFE-Net achieves the best performance in this task.
title Spectrum-guided Feature Enhancement Network for Event Person Re-Identification
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2402.01269