Event-based Video Person Re-identification via Cross-Modality and Temporal Collaboration

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Renkai, Yuan, Xin, Liu, Wei, Xu, Xin
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909455115878400
author Li, Renkai
Yuan, Xin
Liu, Wei
Xu, Xin
author_facet Li, Renkai
Yuan, Xin
Liu, Wei
Xu, Xin
contents Video-based person re-identification (ReID) has become increasingly important due to its applications in video surveillance applications. By employing events in video-based person ReID, more motion information can be provided between continuous frames to improve recognition accuracy. Previous approaches have assisted by introducing event data into the video person ReID task, but they still cannot avoid the privacy leakage problem caused by RGB images. In order to avoid privacy attacks and to take advantage of the benefits of event data, we consider using only event data. To make full use of the information in the event stream, we propose a Cross-Modality and Temporal Collaboration (CMTC) network for event-based video person ReID. First, we design an event transform network to obtain corresponding auxiliary information from the input of raw events. Additionally, we propose a differential modality collaboration module to balance the roles of events and auxiliaries to achieve complementary effects. Furthermore, we introduce a temporal collaboration module to exploit motion information and appearance cues. Experimental results demonstrate that our method outperforms others in the task of event-based video person ReID.
format Preprint
id arxiv_https___arxiv_org_abs_2501_07296
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Event-based Video Person Re-identification via Cross-Modality and Temporal Collaboration
Li, Renkai
Yuan, Xin
Liu, Wei
Xu, Xin
Computer Vision and Pattern Recognition
Video-based person re-identification (ReID) has become increasingly important due to its applications in video surveillance applications. By employing events in video-based person ReID, more motion information can be provided between continuous frames to improve recognition accuracy. Previous approaches have assisted by introducing event data into the video person ReID task, but they still cannot avoid the privacy leakage problem caused by RGB images. In order to avoid privacy attacks and to take advantage of the benefits of event data, we consider using only event data. To make full use of the information in the event stream, we propose a Cross-Modality and Temporal Collaboration (CMTC) network for event-based video person ReID. First, we design an event transform network to obtain corresponding auxiliary information from the input of raw events. Additionally, we propose a differential modality collaboration module to balance the roles of events and auxiliaries to achieve complementary effects. Furthermore, we introduce a temporal collaboration module to exploit motion information and appearance cues. Experimental results demonstrate that our method outperforms others in the task of event-based video person ReID.
title Event-based Video Person Re-identification via Cross-Modality and Temporal Collaboration
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2501.07296