Sharing the Learned Knowledge-base to Estimate Convolutional Filter Parameters for Continual Image Restoration

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Kar, Aupendu, Ghosh, Krishnendu, Biswas, Prabir Kumar
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918400839647232
author Kar, Aupendu
Ghosh, Krishnendu
Biswas, Prabir Kumar
author_facet Kar, Aupendu
Ghosh, Krishnendu
Biswas, Prabir Kumar
contents Continual learning is an emerging topic in the field of deep learning, where a model is expected to learn continuously for new upcoming tasks without forgetting previous experiences. This field has witnessed numerous advancements, but few works have been attempted in the direction of image restoration. Handling large image sizes and the divergent nature of various degradation poses a unique challenge in the restoration domain. However, existing works require heavily engineered architectural modifications for new task adaptation, resulting in significant computational overhead. Regularization-based methods are unsuitable for restoration, as different restoration challenges require different kinds of feature processing. In this direction, we propose a simple modification of the convolution layer to adapt the knowledge from previous restoration tasks without touching the main backbone architecture. Therefore, it can be seamlessly applied to any deep architecture without any structural modifications. Unlike other approaches, we demonstrate that our model can increase the number of trainable parameters without significantly increasing computational overhead or inference time. Experimental validation demonstrates that new restoration tasks can be introduced without compromising the performance of existing tasks. We also show that performance on new restoration tasks improves by adapting the knowledge from the knowledge base created by previous restoration tasks. The code is available at https://github.com/aupendu/continual-restore.
format Preprint
id arxiv_https___arxiv_org_abs_2511_05421
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Sharing the Learned Knowledge-base to Estimate Convolutional Filter Parameters for Continual Image Restoration
Kar, Aupendu
Ghosh, Krishnendu
Biswas, Prabir Kumar
Computer Vision and Pattern Recognition
Continual learning is an emerging topic in the field of deep learning, where a model is expected to learn continuously for new upcoming tasks without forgetting previous experiences. This field has witnessed numerous advancements, but few works have been attempted in the direction of image restoration. Handling large image sizes and the divergent nature of various degradation poses a unique challenge in the restoration domain. However, existing works require heavily engineered architectural modifications for new task adaptation, resulting in significant computational overhead. Regularization-based methods are unsuitable for restoration, as different restoration challenges require different kinds of feature processing. In this direction, we propose a simple modification of the convolution layer to adapt the knowledge from previous restoration tasks without touching the main backbone architecture. Therefore, it can be seamlessly applied to any deep architecture without any structural modifications. Unlike other approaches, we demonstrate that our model can increase the number of trainable parameters without significantly increasing computational overhead or inference time. Experimental validation demonstrates that new restoration tasks can be introduced without compromising the performance of existing tasks. We also show that performance on new restoration tasks improves by adapting the knowledge from the knowledge base created by previous restoration tasks. The code is available at https://github.com/aupendu/continual-restore.
title Sharing the Learned Knowledge-base to Estimate Convolutional Filter Parameters for Continual Image Restoration
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.05421