Image Restoration Learning via Noisy Supervision in the Fourier Domain

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Liu, Haosen, Liu, Jiahao, Tan, Shan, Lam, Edmund Y.
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866912406137995264
author Liu, Haosen
Liu, Jiahao
Tan, Shan
Lam, Edmund Y.
author_facet Liu, Haosen
Liu, Jiahao
Tan, Shan
Lam, Edmund Y.
contents Noisy supervision refers to supervising image restoration learning with noisy targets. It can alleviate the data collection burden and enhance the practical applicability of deep learning techniques. However, existing methods suffer from two key drawbacks. Firstly, they are ineffective in handling spatially correlated noise commonly observed in practical applications such as low-light imaging and remote sensing. Secondly, they rely on pixel-wise loss functions that only provide limited supervision information. This work addresses these challenges by leveraging the Fourier domain. We highlight that the Fourier coefficients of spatially correlated noise exhibit sparsity and independence, making them easier to handle. Additionally, Fourier coefficients contain global information, enabling more significant supervision. Motivated by these insights, we propose to establish noisy supervision in the Fourier domain. We first prove that Fourier coefficients of a wide range of noise converge in distribution to the Gaussian distribution. Exploiting this statistical property, we establish the equivalence between using noisy targets and clean targets in the Fourier domain. This leads to a unified learning framework applicable to various image restoration tasks, diverse network architectures, and different noise models. Extensive experiments validate the outstanding performance of this framework in terms of both quantitative indices and perceptual quality.
format Preprint
id arxiv_https___arxiv_org_abs_2506_00564
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Image Restoration Learning via Noisy Supervision in the Fourier Domain
Liu, Haosen
Liu, Jiahao
Tan, Shan
Lam, Edmund Y.
Image and Video Processing
Computer Vision and Pattern Recognition
Noisy supervision refers to supervising image restoration learning with noisy targets. It can alleviate the data collection burden and enhance the practical applicability of deep learning techniques. However, existing methods suffer from two key drawbacks. Firstly, they are ineffective in handling spatially correlated noise commonly observed in practical applications such as low-light imaging and remote sensing. Secondly, they rely on pixel-wise loss functions that only provide limited supervision information. This work addresses these challenges by leveraging the Fourier domain. We highlight that the Fourier coefficients of spatially correlated noise exhibit sparsity and independence, making them easier to handle. Additionally, Fourier coefficients contain global information, enabling more significant supervision. Motivated by these insights, we propose to establish noisy supervision in the Fourier domain. We first prove that Fourier coefficients of a wide range of noise converge in distribution to the Gaussian distribution. Exploiting this statistical property, we establish the equivalence between using noisy targets and clean targets in the Fourier domain. This leads to a unified learning framework applicable to various image restoration tasks, diverse network architectures, and different noise models. Extensive experiments validate the outstanding performance of this framework in terms of both quantitative indices and perceptual quality.
title Image Restoration Learning via Noisy Supervision in the Fourier Domain
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.00564