Enregistré dans:
Détails bibliographiques
Auteurs principaux: Lyu, Jiahao, Zhao, Minghua, Hu, Jing, Xi, Runtao, Huang, Xuewen, Du, Shuangli, Shi, Cheng, Ma, Tian
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:https://arxiv.org/abs/2407.15424
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908801175650304
author Lyu, Jiahao
Zhao, Minghua
Hu, Jing
Xi, Runtao
Huang, Xuewen
Du, Shuangli
Shi, Cheng
Ma, Tian
author_facet Lyu, Jiahao
Zhao, Minghua
Hu, Jing
Xi, Runtao
Huang, Xuewen
Du, Shuangli
Shi, Cheng
Ma, Tian
contents With the widespread deployment of video surveillance devices and the demand for intelligent system development, video anomaly detection (VAD) has become an important part of constructing intelligent surveillance systems. Expanding the discriminative boundary between normal and abnormal events to enhance performance is the common goal and challenge of VAD. To address this problem, we propose a Bidirectional Skip-frame Prediction (BiSP) network based on a dual-stream autoencoder, from the perspective of learning the intra-domain disparity between different features. The BiSP skips frames in the training phase to achieve the forward and backward frame prediction respectively, and in the testing phase, it utilizes bidirectional consecutive frames to co-predict the same intermediate frames, thus expanding the degree of disparity between normal and abnormal events. The BiSP designs the variance channel attention and context spatial attention from the perspectives of movement patterns and object scales, respectively, thus ensuring the maximization of the disparity between normal and abnormal in the feature extraction and delivery with different dimensions. Extensive experiments from four benchmark datasets demonstrate the effectiveness of the proposed BiSP, which substantially outperforms state-of-the-art competing methods.
format Preprint
id arxiv_https___arxiv_org_abs_2407_15424
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Bidirectional skip-frame prediction for video anomaly detection with intra-domain disparity-driven attention
Lyu, Jiahao
Zhao, Minghua
Hu, Jing
Xi, Runtao
Huang, Xuewen
Du, Shuangli
Shi, Cheng
Ma, Tian
Computer Vision and Pattern Recognition
With the widespread deployment of video surveillance devices and the demand for intelligent system development, video anomaly detection (VAD) has become an important part of constructing intelligent surveillance systems. Expanding the discriminative boundary between normal and abnormal events to enhance performance is the common goal and challenge of VAD. To address this problem, we propose a Bidirectional Skip-frame Prediction (BiSP) network based on a dual-stream autoencoder, from the perspective of learning the intra-domain disparity between different features. The BiSP skips frames in the training phase to achieve the forward and backward frame prediction respectively, and in the testing phase, it utilizes bidirectional consecutive frames to co-predict the same intermediate frames, thus expanding the degree of disparity between normal and abnormal events. The BiSP designs the variance channel attention and context spatial attention from the perspectives of movement patterns and object scales, respectively, thus ensuring the maximization of the disparity between normal and abnormal in the feature extraction and delivery with different dimensions. Extensive experiments from four benchmark datasets demonstrate the effectiveness of the proposed BiSP, which substantially outperforms state-of-the-art competing methods.
title Bidirectional skip-frame prediction for video anomaly detection with intra-domain disparity-driven attention
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2407.15424