A General Method to Incorporate Spatial Information into Loss Functions for GAN-based Super-resolution Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913267082854400 |
|---|---|
| author | Wang, Xijun López-Tapia, Santiago Lucas, Alice Wu, Xinyi Molina, Rafael Katsaggelos, Aggelos K. |
| author_facet | Wang, Xijun López-Tapia, Santiago Lucas, Alice Wu, Xinyi Molina, Rafael Katsaggelos, Aggelos K. |
| contents | Generative Adversarial Networks (GANs) have shown great performance on super-resolution problems since they can generate more visually realistic images and video frames. However, these models often introduce side effects into the outputs, such as unexpected artifacts and noises. To reduce these artifacts and enhance the perceptual quality of the results, in this paper, we propose a general method that can be effectively used in most GAN-based super-resolution (SR) models by introducing essential spatial information into the training process. We extract spatial information from the input data and incorporate it into the training loss, making the corresponding loss a spatially adaptive (SA) one. After that, we utilize it to guide the training process. We will show that the proposed approach is independent of the methods used to extract the spatial information and independent of the SR tasks and models. This method consistently guides the training process towards generating visually pleasing SR images and video frames, substantially mitigating artifacts and noise, ultimately leading to enhanced perceptual quality. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2403_10589 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | A General Method to Incorporate Spatial Information into Loss Functions for GAN-based Super-resolution Models Wang, Xijun López-Tapia, Santiago Lucas, Alice Wu, Xinyi Molina, Rafael Katsaggelos, Aggelos K. Image and Video Processing Computer Vision and Pattern Recognition Generative Adversarial Networks (GANs) have shown great performance on super-resolution problems since they can generate more visually realistic images and video frames. However, these models often introduce side effects into the outputs, such as unexpected artifacts and noises. To reduce these artifacts and enhance the perceptual quality of the results, in this paper, we propose a general method that can be effectively used in most GAN-based super-resolution (SR) models by introducing essential spatial information into the training process. We extract spatial information from the input data and incorporate it into the training loss, making the corresponding loss a spatially adaptive (SA) one. After that, we utilize it to guide the training process. We will show that the proposed approach is independent of the methods used to extract the spatial information and independent of the SR tasks and models. This method consistently guides the training process towards generating visually pleasing SR images and video frames, substantially mitigating artifacts and noise, ultimately leading to enhanced perceptual quality. |
| title | A General Method to Incorporate Spatial Information into Loss Functions for GAN-based Super-resolution Models |
| topic | Image and Video Processing Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2403.10589 |