DDR: Exploiting Deep Degradation Response as Flexible Image Descriptor

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wu, Juncheng, Ni, Zhangkai, Wang, Hanli, Yang, Wenhan, Zhou, Yuyin, Wang, Shiqi
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914972291825664
author Wu, Juncheng
Ni, Zhangkai
Wang, Hanli
Yang, Wenhan
Zhou, Yuyin
Wang, Shiqi
author_facet Wu, Juncheng
Ni, Zhangkai
Wang, Hanli
Yang, Wenhan
Zhou, Yuyin
Wang, Shiqi
contents Image deep features extracted by pre-trained networks are known to contain rich and informative representations. In this paper, we present Deep Degradation Response (DDR), a method to quantify changes in image deep features under varying degradation conditions. Specifically, our approach facilitates flexible and adaptive degradation, enabling the controlled synthesis of image degradation through text-driven prompts. Extensive evaluations demonstrate the versatility of DDR as an image descriptor, with strong correlations observed with key image attributes such as complexity, colorfulness, sharpness, and overall quality. Moreover, we demonstrate the efficacy of DDR across a spectrum of applications. It excels as a blind image quality assessment metric, outperforming existing methodologies across multiple datasets. Additionally, DDR serves as an effective unsupervised learning objective in image restoration tasks, yielding notable advancements in image deblurring and single-image super-resolution. Our code is available at: https://github.com/eezkni/DDR
format Preprint
id arxiv_https___arxiv_org_abs_2406_08377
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle DDR: Exploiting Deep Degradation Response as Flexible Image Descriptor
Wu, Juncheng
Ni, Zhangkai
Wang, Hanli
Yang, Wenhan
Zhou, Yuyin
Wang, Shiqi
Computer Vision and Pattern Recognition
Image deep features extracted by pre-trained networks are known to contain rich and informative representations. In this paper, we present Deep Degradation Response (DDR), a method to quantify changes in image deep features under varying degradation conditions. Specifically, our approach facilitates flexible and adaptive degradation, enabling the controlled synthesis of image degradation through text-driven prompts. Extensive evaluations demonstrate the versatility of DDR as an image descriptor, with strong correlations observed with key image attributes such as complexity, colorfulness, sharpness, and overall quality. Moreover, we demonstrate the efficacy of DDR across a spectrum of applications. It excels as a blind image quality assessment metric, outperforming existing methodologies across multiple datasets. Additionally, DDR serves as an effective unsupervised learning objective in image restoration tasks, yielding notable advancements in image deblurring and single-image super-resolution. Our code is available at: https://github.com/eezkni/DDR
title DDR: Exploiting Deep Degradation Response as Flexible Image Descriptor
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2406.08377