HASN: Hybrid Attention Separable Network for Efficient Image Super-resolution

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Cao, Weifeng, Lei, Xiaoyan, Shi, Jun, Liang, Wanyong, Liu, Jie, Bai, Zongfei
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916437139914752
author Cao, Weifeng
Lei, Xiaoyan
Shi, Jun
Liang, Wanyong
Liu, Jie
Bai, Zongfei
author_facet Cao, Weifeng
Lei, Xiaoyan
Shi, Jun
Liang, Wanyong
Liu, Jie
Bai, Zongfei
contents Recently, lightweight methods for single image super-resolution (SISR) have gained significant popularity and achieved impressive performance due to limited hardware resources. These methods demonstrate that adopting residual feature distillation is an effective way to enhance performance. However, we find that using residual connections after each block increases the model's storage and computational cost. Therefore, to simplify the network structure and learn higher-level features and relationships between features, we use depthwise separable convolutions, fully connected layers, and activation functions as the basic feature extraction modules. This significantly reduces computational load and the number of parameters while maintaining strong feature extraction capabilities. To further enhance model performance, we propose the Hybrid Attention Separable Block (HASB), which combines channel attention and spatial attention, thus making use of their complementary advantages. Additionally, we use depthwise separable convolutions instead of standard convolutions, significantly reducing the computational load and the number of parameters while maintaining strong feature extraction capabilities. During the training phase, we also adopt a warm-start retraining strategy to exploit the potential of the model further. Extensive experiments demonstrate the effectiveness of our approach. Our method achieves a smaller model size and reduced computational complexity without compromising performance. Code can be available at https://github.com/nathan66666/HASN.git
format Preprint
id arxiv_https___arxiv_org_abs_2410_09844
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle HASN: Hybrid Attention Separable Network for Efficient Image Super-resolution
Cao, Weifeng
Lei, Xiaoyan
Shi, Jun
Liang, Wanyong
Liu, Jie
Bai, Zongfei
Image and Video Processing
Computer Vision and Pattern Recognition
Recently, lightweight methods for single image super-resolution (SISR) have gained significant popularity and achieved impressive performance due to limited hardware resources. These methods demonstrate that adopting residual feature distillation is an effective way to enhance performance. However, we find that using residual connections after each block increases the model's storage and computational cost. Therefore, to simplify the network structure and learn higher-level features and relationships between features, we use depthwise separable convolutions, fully connected layers, and activation functions as the basic feature extraction modules. This significantly reduces computational load and the number of parameters while maintaining strong feature extraction capabilities. To further enhance model performance, we propose the Hybrid Attention Separable Block (HASB), which combines channel attention and spatial attention, thus making use of their complementary advantages. Additionally, we use depthwise separable convolutions instead of standard convolutions, significantly reducing the computational load and the number of parameters while maintaining strong feature extraction capabilities. During the training phase, we also adopt a warm-start retraining strategy to exploit the potential of the model further. Extensive experiments demonstrate the effectiveness of our approach. Our method achieves a smaller model size and reduced computational complexity without compromising performance. Code can be available at https://github.com/nathan66666/HASN.git
title HASN: Hybrid Attention Separable Network for Efficient Image Super-resolution
topic Image and Video Processing
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2410.09844