Review Learning: Advancing All-in-One Ultra-High-Definition Image Restoration Training Method

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Su, Xin, Zheng, Zhuoran, Wu, Chen
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866910564742070272
author Su, Xin
Zheng, Zhuoran
Wu, Chen
author_facet Su, Xin
Zheng, Zhuoran
Wu, Chen
contents All-in-one image restoration tasks are becoming increasingly important, especially for ultra-high-definition (UHD) images. Existing all-in-one UHD image restoration methods usually boost the model's performance by introducing prompt or customized dynamized networks for different degradation types. For the inference stage, it might be friendly, but in the training stage, since the model encounters multiple degraded images of different quality in an epoch, these cluttered learning objectives might be information pollution for the model. To address this problem, we propose a new training paradigm for general image restoration models, which we name \textbf{Review Learning}, which enables image restoration models to be capable enough to handle multiple types of degradation without prior knowledge and prompts. This approach begins with sequential training of an image restoration model on several degraded datasets, combined with a review mechanism that enhances the image restoration model's memory for several previous classes of degraded datasets. In addition, we design a lightweight all-purpose image restoration network that can efficiently reason about degraded images with 4K ($3840 \times 2160$) resolution on a single consumer-grade GPU.
format Preprint
id arxiv_https___arxiv_org_abs_2408_06709
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Review Learning: Advancing All-in-One Ultra-High-Definition Image Restoration Training Method
Su, Xin
Zheng, Zhuoran
Wu, Chen
Computer Vision and Pattern Recognition
All-in-one image restoration tasks are becoming increasingly important, especially for ultra-high-definition (UHD) images. Existing all-in-one UHD image restoration methods usually boost the model's performance by introducing prompt or customized dynamized networks for different degradation types. For the inference stage, it might be friendly, but in the training stage, since the model encounters multiple degraded images of different quality in an epoch, these cluttered learning objectives might be information pollution for the model. To address this problem, we propose a new training paradigm for general image restoration models, which we name \textbf{Review Learning}, which enables image restoration models to be capable enough to handle multiple types of degradation without prior knowledge and prompts. This approach begins with sequential training of an image restoration model on several degraded datasets, combined with a review mechanism that enhances the image restoration model's memory for several previous classes of degraded datasets. In addition, we design a lightweight all-purpose image restoration network that can efficiently reason about degraded images with 4K ($3840 \times 2160$) resolution on a single consumer-grade GPU.
title Review Learning: Advancing All-in-One Ultra-High-Definition Image Restoration Training Method
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2408.06709