Saved in:
Bibliographic Details
Main Authors: Li, Yixiao, Yang, Xiaoyuan, Fu, Jun, Yue, Guanghui, Zhou, Wei
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2403.10406
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911806741544960
author Li, Yixiao
Yang, Xiaoyuan
Fu, Jun
Yue, Guanghui
Zhou, Wei
author_facet Li, Yixiao
Yang, Xiaoyuan
Fu, Jun
Yue, Guanghui
Zhou, Wei
contents There has emerged a growing interest in exploring efficient quality assessment algorithms for image super-resolution (SR). However, employing deep learning techniques, especially dual-branch algorithms, to automatically evaluate the visual quality of SR images remains challenging. Existing SR image quality assessment (IQA) metrics based on two-stream networks lack interactions between branches. To address this, we propose a novel full-reference IQA (FR-IQA) method for SR images. Specifically, producing SR images and evaluating how close the SR images are to the corresponding HR references are separate processes. Based on this consideration, we construct a deep Bi-directional Attention Network (BiAtten-Net) that dynamically deepens visual attention to distortions in both processes, which aligns well with the human visual system (HVS). Experiments on public SR quality databases demonstrate the superiority of our proposed BiAtten-Net over state-of-the-art quality assessment methods. In addition, the visualization results and ablation study show the effectiveness of bi-directional attention.
format Preprint
id arxiv_https___arxiv_org_abs_2403_10406
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Deep Bi-directional Attention Network for Image Super-Resolution Quality Assessment
Li, Yixiao
Yang, Xiaoyuan
Fu, Jun
Yue, Guanghui
Zhou, Wei
Multimedia
There has emerged a growing interest in exploring efficient quality assessment algorithms for image super-resolution (SR). However, employing deep learning techniques, especially dual-branch algorithms, to automatically evaluate the visual quality of SR images remains challenging. Existing SR image quality assessment (IQA) metrics based on two-stream networks lack interactions between branches. To address this, we propose a novel full-reference IQA (FR-IQA) method for SR images. Specifically, producing SR images and evaluating how close the SR images are to the corresponding HR references are separate processes. Based on this consideration, we construct a deep Bi-directional Attention Network (BiAtten-Net) that dynamically deepens visual attention to distortions in both processes, which aligns well with the human visual system (HVS). Experiments on public SR quality databases demonstrate the superiority of our proposed BiAtten-Net over state-of-the-art quality assessment methods. In addition, the visualization results and ablation study show the effectiveness of bi-directional attention.
title Deep Bi-directional Attention Network for Image Super-Resolution Quality Assessment
topic Multimedia
url https://arxiv.org/abs/2403.10406