EVCC: Enhanced Vision Transformer-ConvNeXt-CoAtNet Fusion for Classification
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912726416097280 |
|---|---|
| author | Hasan, Kazi Reyazul Rahman, Md Nafiu Jalal, Wasif Ahmed, Sadif Raj, Shahriar Musarrat, Mubasshira Adnan, Muhammad Abdullah |
| author_facet | Hasan, Kazi Reyazul Rahman, Md Nafiu Jalal, Wasif Ahmed, Sadif Raj, Shahriar Musarrat, Mubasshira Adnan, Muhammad Abdullah |
| contents | Hybrid vision architectures combining Transformers and CNNs have significantly advanced image classification, but they usually do so at significant computational cost. We introduce EVCC (Enhanced Vision Transformer-ConvNeXt-CoAtNet), a novel multi-branch architecture integrating the Vision Transformer, lightweight ConvNeXt, and CoAtNet through key innovations: (1) adaptive token pruning with information preservation, (2) gated bidirectional cross-attention for enhanced feature refinement, (3) auxiliary classification heads for multi-task learning, and (4) a dynamic router gate employing context-aware confidence-driven weighting. Experiments across the CIFAR-100, Tobacco3482, CelebA, and Brain Cancer datasets demonstrate EVCC's superiority over powerful models like DeiT-Base, MaxViT-Base, and CrossViT-Base by consistently achieving state-of-the-art accuracy with improvements of up to 2 percentage points, while reducing FLOPs by 25 to 35%. Our adaptive architecture adjusts computational demands to deployment needs by dynamically reducing token count, efficiently balancing the accuracy-efficiency trade-off while combining global context, local details, and hierarchical features for real-world applications. The source code of our implementation is available at https://anonymous.4open.science/r/EVCC. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_18691 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | EVCC: Enhanced Vision Transformer-ConvNeXt-CoAtNet Fusion for Classification Hasan, Kazi Reyazul Rahman, Md Nafiu Jalal, Wasif Ahmed, Sadif Raj, Shahriar Musarrat, Mubasshira Adnan, Muhammad Abdullah Computer Vision and Pattern Recognition Hybrid vision architectures combining Transformers and CNNs have significantly advanced image classification, but they usually do so at significant computational cost. We introduce EVCC (Enhanced Vision Transformer-ConvNeXt-CoAtNet), a novel multi-branch architecture integrating the Vision Transformer, lightweight ConvNeXt, and CoAtNet through key innovations: (1) adaptive token pruning with information preservation, (2) gated bidirectional cross-attention for enhanced feature refinement, (3) auxiliary classification heads for multi-task learning, and (4) a dynamic router gate employing context-aware confidence-driven weighting. Experiments across the CIFAR-100, Tobacco3482, CelebA, and Brain Cancer datasets demonstrate EVCC's superiority over powerful models like DeiT-Base, MaxViT-Base, and CrossViT-Base by consistently achieving state-of-the-art accuracy with improvements of up to 2 percentage points, while reducing FLOPs by 25 to 35%. Our adaptive architecture adjusts computational demands to deployment needs by dynamically reducing token count, efficiently balancing the accuracy-efficiency trade-off while combining global context, local details, and hierarchical features for real-world applications. The source code of our implementation is available at https://anonymous.4open.science/r/EVCC. |
| title | EVCC: Enhanced Vision Transformer-ConvNeXt-CoAtNet Fusion for Classification |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2511.18691 |