Deep Feature Statistics Mapping for Generalized Screen Content Image Quality Assessment

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Chen, Baoliang, Zhu, Hanwei, Zhu, Lingyu, Wang, Shiqi, Kwong, Sam
Natura: Preprint
Pubblicazione: 2022
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916215589437440
author Chen, Baoliang
Zhu, Hanwei
Zhu, Lingyu
Wang, Shiqi
Kwong, Sam
author_facet Chen, Baoliang
Zhu, Hanwei
Zhu, Lingyu
Wang, Shiqi
Kwong, Sam
contents The statistical regularities of natural images, referred to as natural scene statistics, play an important role in no-reference image quality assessment. However, it has been widely acknowledged that screen content images (SCIs), which are typically computer generated, do not hold such statistics. Here we make the first attempt to learn the statistics of SCIs, based upon which the quality of SCIs can be effectively determined. The underlying mechanism of the proposed approach is based upon the mild assumption that the SCIs, which are not physically acquired, still obey certain statistics that could be understood in a learning fashion. We empirically show that the statistics deviation could be effectively leveraged in quality assessment, and the proposed method is superior when evaluated in different settings. Extensive experimental results demonstrate the Deep Feature Statistics based SCI Quality Assessment (DFSS-IQA) model delivers promising performance compared with existing NR-IQA models and shows a high generalization capability in the cross-dataset settings. The implementation of our method is publicly available at https://github.com/Baoliang93/DFSS-IQA.
format Preprint
id arxiv_https___arxiv_org_abs_2209_05321
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Deep Feature Statistics Mapping for Generalized Screen Content Image Quality Assessment
Chen, Baoliang
Zhu, Hanwei
Zhu, Lingyu
Wang, Shiqi
Kwong, Sam
Computer Vision and Pattern Recognition
The statistical regularities of natural images, referred to as natural scene statistics, play an important role in no-reference image quality assessment. However, it has been widely acknowledged that screen content images (SCIs), which are typically computer generated, do not hold such statistics. Here we make the first attempt to learn the statistics of SCIs, based upon which the quality of SCIs can be effectively determined. The underlying mechanism of the proposed approach is based upon the mild assumption that the SCIs, which are not physically acquired, still obey certain statistics that could be understood in a learning fashion. We empirically show that the statistics deviation could be effectively leveraged in quality assessment, and the proposed method is superior when evaluated in different settings. Extensive experimental results demonstrate the Deep Feature Statistics based SCI Quality Assessment (DFSS-IQA) model delivers promising performance compared with existing NR-IQA models and shows a high generalization capability in the cross-dataset settings. The implementation of our method is publicly available at https://github.com/Baoliang93/DFSS-IQA.
title Deep Feature Statistics Mapping for Generalized Screen Content Image Quality Assessment
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2209.05321