GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditions
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910496159956992 |
|---|---|
| author | Wang, Tao Zhang, Kaihao Shao, Ziqian Luo, Wenhan Stenger, Bjorn Lu, Tong Kim, Tae-Kyun Liu, Wei Li, Hongdong |
| author_facet | Wang, Tao Zhang, Kaihao Shao, Ziqian Luo, Wenhan Stenger, Bjorn Lu, Tong Kim, Tae-Kyun Liu, Wei Li, Hongdong |
| contents | Image restoration in adverse weather conditions is a difficult task in computer vision. In this paper, we propose a novel transformer-based framework called GridFormer which serves as a backbone for image restoration under adverse weather conditions. GridFormer is designed in a grid structure using a residual dense transformer block, and it introduces two core designs. First, it uses an enhanced attention mechanism in the transformer layer. The mechanism includes stages of the sampler and compact self-attention to improve efficiency, and a local enhancement stage to strengthen local information. Second, we introduce a residual dense transformer block (RDTB) as the final GridFormer layer. This design further improves the network's ability to learn effective features from both preceding and current local features. The GridFormer framework achieves state-of-the-art results on five diverse image restoration tasks in adverse weather conditions, including image deraining, dehazing, deraining \& dehazing, desnowing, and multi-weather restoration. The source code and pre-trained models are available at https://github.com/TaoWangzj/GridFormer. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2305_17863 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditions Wang, Tao Zhang, Kaihao Shao, Ziqian Luo, Wenhan Stenger, Bjorn Lu, Tong Kim, Tae-Kyun Liu, Wei Li, Hongdong Computer Vision and Pattern Recognition Image restoration in adverse weather conditions is a difficult task in computer vision. In this paper, we propose a novel transformer-based framework called GridFormer which serves as a backbone for image restoration under adverse weather conditions. GridFormer is designed in a grid structure using a residual dense transformer block, and it introduces two core designs. First, it uses an enhanced attention mechanism in the transformer layer. The mechanism includes stages of the sampler and compact self-attention to improve efficiency, and a local enhancement stage to strengthen local information. Second, we introduce a residual dense transformer block (RDTB) as the final GridFormer layer. This design further improves the network's ability to learn effective features from both preceding and current local features. The GridFormer framework achieves state-of-the-art results on five diverse image restoration tasks in adverse weather conditions, including image deraining, dehazing, deraining \& dehazing, desnowing, and multi-weather restoration. The source code and pre-trained models are available at https://github.com/TaoWangzj/GridFormer. |
| title | GridFormer: Residual Dense Transformer with Grid Structure for Image Restoration in Adverse Weather Conditions |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2305.17863 |