Copertina

MABViT -- Modified Attention Block Enhances Vision Transformers

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Ramesh, Mahesh, Ramkumar, Aswinkumar
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Computer Vision and Pattern Recognition Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Block Selective Reprogramming for On-device Training of Vision Transformers
di: Sarkar, Sreetama, et al.
Pubblicazione: (2024)

Elastic Attention Cores for Scalable Vision Transformers
di: Song, Alan Z., et al.
Pubblicazione: (2026)

Attention Transfer Is Not Universally Effective for Vision Transformers
di: Qin, Huaiyuan, et al.
Pubblicazione: (2026)

Block-Recurrent Dynamics in Vision Transformers
di: Jacobs, Mozes, et al.
Pubblicazione: (2025)

ASCENT-ViT: Attention-based Scale-aware Concept Learning Framework for Enhanced Alignment in Vision Transformers
di: Sinha, Sanchit, et al.
Pubblicazione: (2025)

AnchorFormer: Differentiable Anchor Attention for Efficient Vision Transformer
di: Shan, Jiquan, et al.
Pubblicazione: (2025)

Focus Your Attention: Towards Data-Intuitive Lightweight Vision Transformers
di: Gaurav, Suyash, et al.
Pubblicazione: (2025)

ELSA: Exact Linear-Scan Attention for Fast and Memory-Light Vision Transformers
di: Hsu, Chih-Chung, et al.
Pubblicazione: (2026)

Discrete Cosine Transform Based Decorrelated Attention for Vision Transformers
di: Pan, Hongyi, et al.
Pubblicazione: (2024)

Class-Discriminative Attention Maps for Vision Transformers
di: Brocki, Lennart, et al.
Pubblicazione: (2023)

ParFormer: A Vision Transformer with Parallel Mixer and Sparse Channel Attention Patch Embedding
di: Setyawan, Novendra, et al.
Pubblicazione: (2024)

LetheViT: Selective Machine Unlearning for Vision Transformers via Attention-Guided Contrastive Learning
di: Tong, Yujia, et al.
Pubblicazione: (2025)

Memory Efficient Neural Processes via Constant Memory Attention Block
di: Feng, Leo, et al.
Pubblicazione: (2023)

SATA: Spatial Autocorrelation Token Analysis for Enhancing the Robustness of Vision Transformers
di: Nikzad, Nick, et al.
Pubblicazione: (2024)

FasterViT: Fast Vision Transformers with Hierarchical Attention
di: Hatamizadeh, Ali, et al.
Pubblicazione: (2023)

SU-ESRGAN: Semantic and Uncertainty-Aware ESRGAN for Super-Resolution of Satellite and Drone Imagery with Fine-Tuning for Cross Domain Evaluation
di: Ramkumar, Prerana
Pubblicazione: (2025)

ProvRain: Rain-Adaptive Denoising and Vehicle Detection via MobileNet-UNet and Faster R-CNN
di: Varathakumaran, Aswinkumar, et al.
Pubblicazione: (2025)

Integrating ConvNeXt and Vision Transformers for Enhancing Facial Age Estimation
di: Maroun, Gaby, et al.
Pubblicazione: (2025)

Fairness-aware Vision Transformer via Debiased Self-Attention
di: Qiang, Yao, et al.
Pubblicazione: (2023)

DPL: Decoupled Prototype Learning for Enhancing Robustness of Vision-Language Transformers to Missing Modalities
di: Lu, Jueqing, et al.
Pubblicazione: (2025)

Enhancing Parameter-Efficient Fine-Tuning of Vision Transformers through Frequency-Based Adaptation
di: Ly, Son Thai, et al.
Pubblicazione: (2024)

Native Segmentation Vision Transformers
di: Brasó, Guillem, et al.
Pubblicazione: (2025)

Rethinking Attention: Polynomial Alternatives to Softmax in Transformers
di: Saratchandran, Hemanth, et al.
Pubblicazione: (2024)

Attention Guided Alignment in Efficient Vision-Language Models
di: Mahajan, Shweta, et al.
Pubblicazione: (2025)

Synthesizer Based Efficient Self-Attention for Vision Tasks
di: Zhu, Guangyang, et al.
Pubblicazione: (2022)

Iwin Transformer: Hierarchical Vision Transformer using Interleaved Windows
di: Huo, Simin, et al.
Pubblicazione: (2025)

Slicing Vision Transformer for Flexible Inference
di: Zhang, Yitian, et al.
Pubblicazione: (2024)

RAViT: Resolution-Adaptive Vision Transformer
di: Guidez, Martial, et al.
Pubblicazione: (2026)

Rotary Position Embedding for Vision Transformer
di: Heo, Byeongho, et al.
Pubblicazione: (2024)

Decorrelation Speeds Up Vision Transformers
di: Carrigg, Kieran, et al.
Pubblicazione: (2025)

Separate, Dynamic and Differentiable (SMART) Pruner for Block/Output Channel Pruning on Computer Vision Tasks
di: Ding, Guanhua, et al.
Pubblicazione: (2024)

EDiT: Efficient Diffusion Transformers with Linear Compressed Attention
di: Becker, Philipp, et al.
Pubblicazione: (2025)

SparseSwin: Swin Transformer with Sparse Transformer Block
di: Pinasthika, Krisna, et al.
Pubblicazione: (2023)

On the Surprising Effectiveness of Attention Transfer for Vision Transformers
di: Li, Alexander C., et al.
Pubblicazione: (2024)

A Novel Approach to Chest X-ray Lung Segmentation Using U-net and Modified Convolutional Block Attention Module
di: Khaniki, Mohammad Ali Labbaf, et al.
Pubblicazione: (2024)

Enhancing Vision Transformer Explainability Using Artificial Astrocytes
di: Echevarrieta-Catalan, Nicolas, et al.
Pubblicazione: (2025)

HEAL-SWIN: A Vision Transformer On The Sphere
di: Carlsson, Oscar, et al.
Pubblicazione: (2023)

SPoT: Subpixel Placement of Tokens in Vision Transformers
di: Hjelkrem-Tan, Martine, et al.
Pubblicazione: (2025)

Instance-Aware Group Quantization for Vision Transformers
di: Moon, Jaehyeon, et al.
Pubblicazione: (2024)

Vision Transformer-based Adversarial Domain Adaptation
di: Li, Yahan, et al.
Pubblicazione: (2024)