Multi-scale frequency separation network for image deblurring

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Yanni, Li, Qiang, Qi, Miao, Liu, Di, Kong, Jun, Wang, Jianzhong
Format: Preprint
Published: 2022
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910668504956928
author Zhang, Yanni
Li, Qiang
Qi, Miao
Liu, Di
Kong, Jun
Wang, Jianzhong
author_facet Zhang, Yanni
Li, Qiang
Qi, Miao
Liu, Di
Kong, Jun
Wang, Jianzhong
contents Image deblurring aims to restore the detailed texture information or structures from blurry images, which has become an indispensable step in many computer vision tasks. Although various methods have been proposed to deal with the image deblurring problem, most of them treated the blurry image as a whole and neglected the characteristics of different image frequencies. In this paper, we present a new method called multi-scale frequency separation network (MSFS-Net) for image deblurring. MSFS-Net introduces the frequency separation module (FSM) into an encoder-decoder network architecture to capture the low- and high-frequency information of image at multiple scales. Then, a cycle-consistency strategy and a contrastive learning module (CLM) are respectively designed to retain the low-frequency information and recover the high-frequency information during deblurring. At last, the features of different scales are fused by a cross-scale feature fusion module (CSFFM). Extensive experiments on benchmark datasets show that the proposed network achieves state-of-the-art performance.
format Preprint
id arxiv_https___arxiv_org_abs_2206_00798
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Multi-scale frequency separation network for image deblurring
Zhang, Yanni
Li, Qiang
Qi, Miao
Liu, Di
Kong, Jun
Wang, Jianzhong
Computer Vision and Pattern Recognition
Image deblurring aims to restore the detailed texture information or structures from blurry images, which has become an indispensable step in many computer vision tasks. Although various methods have been proposed to deal with the image deblurring problem, most of them treated the blurry image as a whole and neglected the characteristics of different image frequencies. In this paper, we present a new method called multi-scale frequency separation network (MSFS-Net) for image deblurring. MSFS-Net introduces the frequency separation module (FSM) into an encoder-decoder network architecture to capture the low- and high-frequency information of image at multiple scales. Then, a cycle-consistency strategy and a contrastive learning module (CLM) are respectively designed to retain the low-frequency information and recover the high-frequency information during deblurring. At last, the features of different scales are fused by a cross-scale feature fusion module (CSFFM). Extensive experiments on benchmark datasets show that the proposed network achieves state-of-the-art performance.
title Multi-scale frequency separation network for image deblurring
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2206.00798