Causal Disentanglement-Inspired Degradation Representation Learning for Full-Reference Image Quality Assessment

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Zhang, Zhen, Chu, Jielei, Zhang, Tian, Ma, Lin, Lv, Fengmao, Liu, Weide, Li, Tianrui, Fang, Yuming
Format: Preprint
Publié: 2026
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866918528689373184
author Zhang, Zhen
Chu, Jielei
Zhang, Tian
Ma, Lin
Lv, Fengmao
Liu, Weide
Li, Tianrui
Fang, Yuming
author_facet Zhang, Zhen
Chu, Jielei
Zhang, Tian
Ma, Lin
Lv, Fengmao
Liu, Weide
Li, Tianrui
Fang, Yuming
contents Existing deep network-based full-reference image quality assessment (FR-IQA) models typically work by performing pairwise comparisons of deep features from the reference and distorted images. In this paper, we approach this problem from a different perspective and propose a novel FR-IQA paradigm based on causal inference and decoupled representation learning. Unlike typical feature comparison-based FR-IQA models, our approach formulates degradation estimation as a causal disentanglement process guided by intervention on latent representations. We first decouple degradation and content representations by exploiting the content invariance between the reference and distorted images. Second, inspired by the human visual masking effect, we design a masking module to model the causal relationship between image content and degradation features, thereby extracting content-influenced degradation features from distorted images. Finally, quality scores are predicted from these degradation features using either supervised regression or label-free dimensionality reduction. Extensive experiments demonstrate that our method achieves highly competitive performance on standard IQA benchmarks across fully supervised, few-label, and label-free settings. Furthermore, we evaluate the approach on diverse non-standard natural image domains with scarce data, including underwater, radiographic, medical, neutron, and screen-content images. Benefiting from its ability to perform scenario-specific training and prediction without labeled IQA data, our method exhibits superior cross-domain generalization compared to existing training-free FR-IQA models.
format Preprint
id arxiv_https___arxiv_org_abs_2604_21654
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Causal Disentanglement-Inspired Degradation Representation Learning for Full-Reference Image Quality Assessment
Zhang, Zhen
Chu, Jielei
Zhang, Tian
Ma, Lin
Lv, Fengmao
Liu, Weide
Li, Tianrui
Fang, Yuming
Computer Vision and Pattern Recognition
Artificial Intelligence
Existing deep network-based full-reference image quality assessment (FR-IQA) models typically work by performing pairwise comparisons of deep features from the reference and distorted images. In this paper, we approach this problem from a different perspective and propose a novel FR-IQA paradigm based on causal inference and decoupled representation learning. Unlike typical feature comparison-based FR-IQA models, our approach formulates degradation estimation as a causal disentanglement process guided by intervention on latent representations. We first decouple degradation and content representations by exploiting the content invariance between the reference and distorted images. Second, inspired by the human visual masking effect, we design a masking module to model the causal relationship between image content and degradation features, thereby extracting content-influenced degradation features from distorted images. Finally, quality scores are predicted from these degradation features using either supervised regression or label-free dimensionality reduction. Extensive experiments demonstrate that our method achieves highly competitive performance on standard IQA benchmarks across fully supervised, few-label, and label-free settings. Furthermore, we evaluate the approach on diverse non-standard natural image domains with scarce data, including underwater, radiographic, medical, neutron, and screen-content images. Benefiting from its ability to perform scenario-specific training and prediction without labeled IQA data, our method exhibits superior cross-domain generalization compared to existing training-free FR-IQA models.
title Causal Disentanglement-Inspired Degradation Representation Learning for Full-Reference Image Quality Assessment
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2604.21654