Perception-oriented Bidirectional Attention Network for Image Super-resolution Quality Assessment

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Yixiao, Yang, Xiaoyuan, Yue, Guanghui, Fu, Jun, Jiang, Qiuping, Jia, Xu, Rosin, Paul L., Liu, Hantao, Zhou, Wei
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908524630507520
author Li, Yixiao
Yang, Xiaoyuan
Yue, Guanghui
Fu, Jun
Jiang, Qiuping
Jia, Xu
Rosin, Paul L.
Liu, Hantao
Zhou, Wei
author_facet Li, Yixiao
Yang, Xiaoyuan
Yue, Guanghui
Fu, Jun
Jiang, Qiuping
Jia, Xu
Rosin, Paul L.
Liu, Hantao
Zhou, Wei
contents Many super-resolution (SR) algorithms have been proposed to increase image resolution. However, full-reference (FR) image quality assessment (IQA) metrics for comparing and evaluating different SR algorithms are limited. In this work, we propose the Perception-oriented Bidirectional Attention Network (PBAN) for image SR FR-IQA, which is composed of three modules: an image encoder module, a perception-oriented bidirectional attention (PBA) module, and a quality prediction module. First, we encode the input images for feature representations. Inspired by the characteristics of the human visual system, we then construct the perception-oriented PBA module. Specifically, different from existing attention-based SR IQA methods, we conceive a Bidirectional Attention to bidirectionally construct visual attention to distortion, which is consistent with the generation and evaluation processes of SR images. To further guide the quality assessment towards the perception of distorted information, we propose Grouped Multi-scale Deformable Convolution, enabling the proposed method to adaptively perceive distortion. Moreover, we design Sub-information Excitation Convolution to direct visual perception to both sub-pixel and sub-channel attention. Finally, the quality prediction module is exploited to integrate quality-aware features and regress quality scores. Extensive experiments demonstrate that our proposed PBAN outperforms state-of-the-art quality assessment methods.
format Preprint
id arxiv_https___arxiv_org_abs_2509_06442
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Perception-oriented Bidirectional Attention Network for Image Super-resolution Quality Assessment
Li, Yixiao
Yang, Xiaoyuan
Yue, Guanghui
Fu, Jun
Jiang, Qiuping
Jia, Xu
Rosin, Paul L.
Liu, Hantao
Zhou, Wei
Computer Vision and Pattern Recognition
Image and Video Processing
Many super-resolution (SR) algorithms have been proposed to increase image resolution. However, full-reference (FR) image quality assessment (IQA) metrics for comparing and evaluating different SR algorithms are limited. In this work, we propose the Perception-oriented Bidirectional Attention Network (PBAN) for image SR FR-IQA, which is composed of three modules: an image encoder module, a perception-oriented bidirectional attention (PBA) module, and a quality prediction module. First, we encode the input images for feature representations. Inspired by the characteristics of the human visual system, we then construct the perception-oriented PBA module. Specifically, different from existing attention-based SR IQA methods, we conceive a Bidirectional Attention to bidirectionally construct visual attention to distortion, which is consistent with the generation and evaluation processes of SR images. To further guide the quality assessment towards the perception of distorted information, we propose Grouped Multi-scale Deformable Convolution, enabling the proposed method to adaptively perceive distortion. Moreover, we design Sub-information Excitation Convolution to direct visual perception to both sub-pixel and sub-channel attention. Finally, the quality prediction module is exploited to integrate quality-aware features and regress quality scores. Extensive experiments demonstrate that our proposed PBAN outperforms state-of-the-art quality assessment methods.
title Perception-oriented Bidirectional Attention Network for Image Super-resolution Quality Assessment
topic Computer Vision and Pattern Recognition
Image and Video Processing
url https://arxiv.org/abs/2509.06442