Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2407.12217 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916411438268416 |
|---|---|
| author | Zheng, Yunling Xu, Zeyi Xue, Fanghui Yang, Biao Lyu, Jiancheng Zhang, Shuai Qi, Yingyong Xin, Jack |
| author_facet | Zheng, Yunling Xu, Zeyi Xue, Fanghui Yang, Biao Lyu, Jiancheng Zhang, Shuai Qi, Yingyong Xin, Jack |
| contents | We propose and demonstrate an alternating Fourier and image domain filtering approach for feature extraction as an efficient alternative to build a vision backbone without using the computationally intensive attention. The performance among the lightweight models reaches the state-of-the-art level on ImageNet-1K classification, and improves downstream tasks on object detection and segmentation consistently as well. Our approach also serves as a new tool to compress vision transformers (ViTs). |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_12217 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | AFIDAF: Alternating Fourier and Image Domain Adaptive Filters as an Efficient Alternative to Attention in ViTs Zheng, Yunling Xu, Zeyi Xue, Fanghui Yang, Biao Lyu, Jiancheng Zhang, Shuai Qi, Yingyong Xin, Jack Computer Vision and Pattern Recognition We propose and demonstrate an alternating Fourier and image domain filtering approach for feature extraction as an efficient alternative to build a vision backbone without using the computationally intensive attention. The performance among the lightweight models reaches the state-of-the-art level on ImageNet-1K classification, and improves downstream tasks on object detection and segmentation consistently as well. Our approach also serves as a new tool to compress vision transformers (ViTs). |
| title | AFIDAF: Alternating Fourier and Image Domain Adaptive Filters as an Efficient Alternative to Attention in ViTs |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2407.12217 |