A Comparative Study of NAFNet Baselines for Image Restoration

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Esaulov, Vladislav, Esfahani, M. Moein
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915357667622912
author Esaulov, Vladislav
Esfahani, M. Moein
author_facet Esaulov, Vladislav
Esfahani, M. Moein
contents We study NAFNet (Nonlinear Activation Free Network), a simple and efficient deep learning baseline for image restoration. By using CIFAR10 images corrupted with noise and blur, we conduct an ablation study of NAFNet's core components. Our baseline model implements SimpleGate activation, Simplified Channel Activation (SCA), and LayerNormalization. We compare this baseline to different variants that replace or remove components. Quantitative results (PSNR, SSIM) and examples illustrate how each modification affects restoration performance. Our findings support the NAFNet design: the SimpleGate and simplified attention mechanisms yield better results than conventional activations and attention, while LayerNorm proves to be important for stable training. We conclude with recommendations for model design, discuss potential improvements, and future work.
format Preprint
id arxiv_https___arxiv_org_abs_2506_19845
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Comparative Study of NAFNet Baselines for Image Restoration
Esaulov, Vladislav
Esfahani, M. Moein
Computer Vision and Pattern Recognition
Machine Learning
We study NAFNet (Nonlinear Activation Free Network), a simple and efficient deep learning baseline for image restoration. By using CIFAR10 images corrupted with noise and blur, we conduct an ablation study of NAFNet's core components. Our baseline model implements SimpleGate activation, Simplified Channel Activation (SCA), and LayerNormalization. We compare this baseline to different variants that replace or remove components. Quantitative results (PSNR, SSIM) and examples illustrate how each modification affects restoration performance. Our findings support the NAFNet design: the SimpleGate and simplified attention mechanisms yield better results than conventional activations and attention, while LayerNorm proves to be important for stable training. We conclude with recommendations for model design, discuss potential improvements, and future work.
title A Comparative Study of NAFNet Baselines for Image Restoration
topic Computer Vision and Pattern Recognition
Machine Learning
url https://arxiv.org/abs/2506.19845