Generalized Recorrupted-to-Recorrupted: Self-Supervised Learning Beyond Gaussian Noise

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Monroy, Brayan, Bacca, Jorge, Tachella, Julián
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916665507184640
author Monroy, Brayan
Bacca, Jorge
Tachella, Julián
author_facet Monroy, Brayan
Bacca, Jorge
Tachella, Julián
contents Recorrupted-to-Recorrupted (R2R) has emerged as a methodology for training deep networks for image restoration in a self-supervised manner from noisy measurement data alone, demonstrating equivalence in expectation to the supervised squared loss in the case of Gaussian noise. However, its effectiveness with non-Gaussian noise remains unexplored. In this paper, we propose Generalized R2R (GR2R), extending the R2R framework to handle a broader class of noise distribution as additive noise like log-Rayleigh and address the natural exponential family including Poisson and Gamma noise distributions, which play a key role in many applications including low-photon imaging and synthetic aperture radar. We show that the GR2R loss is an unbiased estimator of the supervised loss and that the popular Stein's unbiased risk estimator can be seen as a special case. A series of experiments with Gaussian, Poisson, and Gamma noise validate GR2R's performance, showing its effectiveness compared to other self-supervised methods.
format Preprint
id arxiv_https___arxiv_org_abs_2412_04648
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Generalized Recorrupted-to-Recorrupted: Self-Supervised Learning Beyond Gaussian Noise
Monroy, Brayan
Bacca, Jorge
Tachella, Julián
Image and Video Processing
Machine Learning
Recorrupted-to-Recorrupted (R2R) has emerged as a methodology for training deep networks for image restoration in a self-supervised manner from noisy measurement data alone, demonstrating equivalence in expectation to the supervised squared loss in the case of Gaussian noise. However, its effectiveness with non-Gaussian noise remains unexplored. In this paper, we propose Generalized R2R (GR2R), extending the R2R framework to handle a broader class of noise distribution as additive noise like log-Rayleigh and address the natural exponential family including Poisson and Gamma noise distributions, which play a key role in many applications including low-photon imaging and synthetic aperture radar. We show that the GR2R loss is an unbiased estimator of the supervised loss and that the popular Stein's unbiased risk estimator can be seen as a special case. A series of experiments with Gaussian, Poisson, and Gamma noise validate GR2R's performance, showing its effectiveness compared to other self-supervised methods.
title Generalized Recorrupted-to-Recorrupted: Self-Supervised Learning Beyond Gaussian Noise
topic Image and Video Processing
Machine Learning
url https://arxiv.org/abs/2412.04648