UniRestorer: Universal Image Restoration via Adaptively Estimating Image Degradation at Proper Granularity
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916750608564224 |
|---|---|
| author | Lin, Jingbo Zhang, Zhilu Li, Wenbo Pei, Renjing Xu, Hang Zhang, Hongzhi Zuo, Wangmeng |
| author_facet | Lin, Jingbo Zhang, Zhilu Li, Wenbo Pei, Renjing Xu, Hang Zhang, Hongzhi Zuo, Wangmeng |
| contents | Recently, considerable progress has been made in all-in-one image restoration. Generally, existing methods can be degradation-agnostic or degradation-aware. However, the former are limited in leveraging degradation-specific restoration, and the latter suffer from the inevitable error in degradation estimation. Consequently, the performance of existing methods has a large gap compared to specific single-task models. In this work, we make a step forward in this topic, and present our UniRestorer with improved restoration performance. Specifically, we perform hierarchical clustering on degradation space, and train a multi-granularity mixture-of-experts (MoE) restoration model. Then, UniRestorer adopts both degradation and granularity estimation to adaptively select an appropriate expert for image restoration. In contrast to existing degradation-agnostic and -aware methods, UniRestorer can leverage degradation estimation to benefit degradation specific restoration, and use granularity estimation to make the model robust to degradation estimation error. Experimental results show that our UniRestorer outperforms state-of-the-art all-in-one methods by a large margin, and is promising in closing the performance gap to specific single task models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2412_20157 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | UniRestorer: Universal Image Restoration via Adaptively Estimating Image Degradation at Proper Granularity Lin, Jingbo Zhang, Zhilu Li, Wenbo Pei, Renjing Xu, Hang Zhang, Hongzhi Zuo, Wangmeng Computer Vision and Pattern Recognition Recently, considerable progress has been made in all-in-one image restoration. Generally, existing methods can be degradation-agnostic or degradation-aware. However, the former are limited in leveraging degradation-specific restoration, and the latter suffer from the inevitable error in degradation estimation. Consequently, the performance of existing methods has a large gap compared to specific single-task models. In this work, we make a step forward in this topic, and present our UniRestorer with improved restoration performance. Specifically, we perform hierarchical clustering on degradation space, and train a multi-granularity mixture-of-experts (MoE) restoration model. Then, UniRestorer adopts both degradation and granularity estimation to adaptively select an appropriate expert for image restoration. In contrast to existing degradation-agnostic and -aware methods, UniRestorer can leverage degradation estimation to benefit degradation specific restoration, and use granularity estimation to make the model robust to degradation estimation error. Experimental results show that our UniRestorer outperforms state-of-the-art all-in-one methods by a large margin, and is promising in closing the performance gap to specific single task models. |
| title | UniRestorer: Universal Image Restoration via Adaptively Estimating Image Degradation at Proper Granularity |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2412.20157 |