Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learning
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866917604508041216 |
|---|---|
| author | Chen, Haoyu Li, Wenbo Gu, Jinjin Ren, Jingjing Sun, Haoze Zou, Xueyi Zhang, Zhensong Yan, Youliang Zhu, Lei |
| author_facet | Chen, Haoyu Li, Wenbo Gu, Jinjin Ren, Jingjing Sun, Haoze Zou, Xueyi Zhang, Zhensong Yan, Youliang Zhu, Lei |
| contents | For image super-resolution (SR), bridging the gap between the performance on synthetic datasets and real-world degradation scenarios remains a challenge. This work introduces a novel "Low-Res Leads the Way" (LWay) training framework, merging Supervised Pre-training with Self-supervised Learning to enhance the adaptability of SR models to real-world images. Our approach utilizes a low-resolution (LR) reconstruction network to extract degradation embeddings from LR images, merging them with super-resolved outputs for LR reconstruction. Leveraging unseen LR images for self-supervised learning guides the model to adapt its modeling space to the target domain, facilitating fine-tuning of SR models without requiring paired high-resolution (HR) images. The integration of Discrete Wavelet Transform (DWT) further refines the focus on high-frequency details. Extensive evaluations show that our method significantly improves the generalization and detail restoration capabilities of SR models on unseen real-world datasets, outperforming existing methods. Our training regime is universally compatible, requiring no network architecture modifications, making it a practical solution for real-world SR applications. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_02601 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learning Chen, Haoyu Li, Wenbo Gu, Jinjin Ren, Jingjing Sun, Haoze Zou, Xueyi Zhang, Zhensong Yan, Youliang Zhu, Lei Image and Video Processing Computer Vision and Pattern Recognition For image super-resolution (SR), bridging the gap between the performance on synthetic datasets and real-world degradation scenarios remains a challenge. This work introduces a novel "Low-Res Leads the Way" (LWay) training framework, merging Supervised Pre-training with Self-supervised Learning to enhance the adaptability of SR models to real-world images. Our approach utilizes a low-resolution (LR) reconstruction network to extract degradation embeddings from LR images, merging them with super-resolved outputs for LR reconstruction. Leveraging unseen LR images for self-supervised learning guides the model to adapt its modeling space to the target domain, facilitating fine-tuning of SR models without requiring paired high-resolution (HR) images. The integration of Discrete Wavelet Transform (DWT) further refines the focus on high-frequency details. Extensive evaluations show that our method significantly improves the generalization and detail restoration capabilities of SR models on unseen real-world datasets, outperforming existing methods. Our training regime is universally compatible, requiring no network architecture modifications, making it a practical solution for real-world SR applications. |
| title | Low-Res Leads the Way: Improving Generalization for Super-Resolution by Self-Supervised Learning |
| topic | Image and Video Processing Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2403.02601 |