Secure Video Quality Assessment Resisting Adversarial Attacks

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Ao-Xiang, Wang, Yuan-Gen, Ran, Yu, Tang, Weixuan, Guan, Qingxiao, Yang, Chunsheng
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912454034849792
author Zhang, Ao-Xiang
Wang, Yuan-Gen
Ran, Yu
Tang, Weixuan
Guan, Qingxiao
Yang, Chunsheng
author_facet Zhang, Ao-Xiang
Wang, Yuan-Gen
Ran, Yu
Tang, Weixuan
Guan, Qingxiao
Yang, Chunsheng
contents The exponential surge in video traffic has intensified the imperative for Video Quality Assessment (VQA). Leveraging cutting-edge architectures, current VQA models have achieved human-comparable accuracy. However, recent studies have revealed the vulnerability of existing VQA models against adversarial attacks. To establish a reliable and practical assessment system, a secure VQA model capable of resisting such malicious attacks is urgently demanded. Unfortunately, no attempt has been made to explore this issue. This paper first attempts to investigate general adversarial defense principles, aiming at endowing existing VQA models with security. Specifically, we first introduce random spatial grid sampling on the video frame for intra-frame defense. Then, we design pixel-wise randomization through a guardian map, globally neutralizing adversarial perturbations. Meanwhile, we extract temporal information from the video sequence as compensation for inter-frame defense. Building upon these principles, we present a novel VQA framework from the security-oriented perspective, termed SecureVQA. Extensive experiments indicate that SecureVQA sets a new benchmark in security while achieving competitive VQA performance compared with state-of-the-art models. Ablation studies delve deeper into analyzing the principles of SecureVQA, demonstrating their generalization and contributions to the security of leading VQA models.
format Preprint
id arxiv_https___arxiv_org_abs_2410_06866
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Secure Video Quality Assessment Resisting Adversarial Attacks
Zhang, Ao-Xiang
Wang, Yuan-Gen
Ran, Yu
Tang, Weixuan
Guan, Qingxiao
Yang, Chunsheng
Computer Vision and Pattern Recognition
Image and Video Processing
The exponential surge in video traffic has intensified the imperative for Video Quality Assessment (VQA). Leveraging cutting-edge architectures, current VQA models have achieved human-comparable accuracy. However, recent studies have revealed the vulnerability of existing VQA models against adversarial attacks. To establish a reliable and practical assessment system, a secure VQA model capable of resisting such malicious attacks is urgently demanded. Unfortunately, no attempt has been made to explore this issue. This paper first attempts to investigate general adversarial defense principles, aiming at endowing existing VQA models with security. Specifically, we first introduce random spatial grid sampling on the video frame for intra-frame defense. Then, we design pixel-wise randomization through a guardian map, globally neutralizing adversarial perturbations. Meanwhile, we extract temporal information from the video sequence as compensation for inter-frame defense. Building upon these principles, we present a novel VQA framework from the security-oriented perspective, termed SecureVQA. Extensive experiments indicate that SecureVQA sets a new benchmark in security while achieving competitive VQA performance compared with state-of-the-art models. Ablation studies delve deeper into analyzing the principles of SecureVQA, demonstrating their generalization and contributions to the security of leading VQA models.
title Secure Video Quality Assessment Resisting Adversarial Attacks
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2410.06866