Image Quality Assessment: Investigating Causal Perceptual Effects with Abductive Counterfactual Inference
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866912165982633984 |
|---|---|
| author | Shen, Wenhao Zhou, Mingliang Chen, Yu Wei, Xuekai Luo, Jun Pu, Huayan Jia, Weijia |
| author_facet | Shen, Wenhao Zhou, Mingliang Chen, Yu Wei, Xuekai Luo, Jun Pu, Huayan Jia, Weijia |
| contents | Existing full-reference image quality assessment (FR-IQA) methods often fail to capture the complex causal mechanisms that underlie human perceptual responses to image distortions, limiting their ability to generalize across diverse scenarios. In this paper, we propose an FR-IQA method based on abductive counterfactual inference to investigate the causal relationships between deep network features and perceptual distortions. First, we explore the causal effects of deep features on perception and integrate causal reasoning with feature comparison, constructing a model that effectively handles complex distortion types across different IQA scenarios. Second, the analysis of the perceptual causal correlations of our proposed method is independent of the backbone architecture and thus can be applied to a variety of deep networks. Through abductive counterfactual experiments, we validate the proposed causal relationships, confirming the model's superior perceptual relevance and interpretability of quality scores. The experimental results demonstrate the robustness and effectiveness of the method, providing competitive quality predictions across multiple benchmarks. The source code is available at https://anonymous.4open.science/r/DeepCausalQuality-25BC. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_16939 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Image Quality Assessment: Investigating Causal Perceptual Effects with Abductive Counterfactual Inference Shen, Wenhao Zhou, Mingliang Chen, Yu Wei, Xuekai Luo, Jun Pu, Huayan Jia, Weijia Computer Vision and Pattern Recognition Existing full-reference image quality assessment (FR-IQA) methods often fail to capture the complex causal mechanisms that underlie human perceptual responses to image distortions, limiting their ability to generalize across diverse scenarios. In this paper, we propose an FR-IQA method based on abductive counterfactual inference to investigate the causal relationships between deep network features and perceptual distortions. First, we explore the causal effects of deep features on perception and integrate causal reasoning with feature comparison, constructing a model that effectively handles complex distortion types across different IQA scenarios. Second, the analysis of the perceptual causal correlations of our proposed method is independent of the backbone architecture and thus can be applied to a variety of deep networks. Through abductive counterfactual experiments, we validate the proposed causal relationships, confirming the model's superior perceptual relevance and interpretability of quality scores. The experimental results demonstrate the robustness and effectiveness of the method, providing competitive quality predictions across multiple benchmarks. The source code is available at https://anonymous.4open.science/r/DeepCausalQuality-25BC. |
| title | Image Quality Assessment: Investigating Causal Perceptual Effects with Abductive Counterfactual Inference |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2412.16939 |