FS-IQA: Certified Feature Smoothing for Robust Image Quality Assessment

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Shumitskaya, Ekaterina, Vatolin, Dmitriy, Antsiferova, Anastasia
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913979236876288
author Shumitskaya, Ekaterina
Vatolin, Dmitriy
Antsiferova, Anastasia
author_facet Shumitskaya, Ekaterina
Vatolin, Dmitriy
Antsiferova, Anastasia
contents We propose a novel certified defense method for Image Quality Assessment (IQA) models based on randomized smoothing with noise applied in the feature space rather than the input space. Unlike prior approaches that inject Gaussian noise directly into input images, often degrading visual quality, our method preserves image fidelity while providing robustness guarantees. To formally connect noise levels in the feature space with corresponding input-space perturbations, we analyze the maximum singular value of the backbone network's Jacobian. Our approach supports both full-reference (FR) and no-reference (NR) IQA models without requiring any architectural modifications, suitable for various scenarios. It is also computationally efficient, requiring a single backbone forward pass per image. Compared to previous methods, it reduces inference time by 99.5% without certification and by 20.6% when certification is applied. We validate our method with extensive experiments on two benchmark datasets, involving six widely-used FR and NR IQA models and comparisons against five state-of-the-art certified defenses. Our results demonstrate consistent improvements in correlation with subjective quality scores by up to 30.9%.
format Preprint
id arxiv_https___arxiv_org_abs_2508_05516
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle FS-IQA: Certified Feature Smoothing for Robust Image Quality Assessment
Shumitskaya, Ekaterina
Vatolin, Dmitriy
Antsiferova, Anastasia
Computer Vision and Pattern Recognition
We propose a novel certified defense method for Image Quality Assessment (IQA) models based on randomized smoothing with noise applied in the feature space rather than the input space. Unlike prior approaches that inject Gaussian noise directly into input images, often degrading visual quality, our method preserves image fidelity while providing robustness guarantees. To formally connect noise levels in the feature space with corresponding input-space perturbations, we analyze the maximum singular value of the backbone network's Jacobian. Our approach supports both full-reference (FR) and no-reference (NR) IQA models without requiring any architectural modifications, suitable for various scenarios. It is also computationally efficient, requiring a single backbone forward pass per image. Compared to previous methods, it reduces inference time by 99.5% without certification and by 20.6% when certification is applied. We validate our method with extensive experiments on two benchmark datasets, involving six widely-used FR and NR IQA models and comparisons against five state-of-the-art certified defenses. Our results demonstrate consistent improvements in correlation with subjective quality scores by up to 30.9%.
title FS-IQA: Certified Feature Smoothing for Robust Image Quality Assessment
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2508.05516