Cover Image

Fusion of regional and sparse attention in Vision Transformers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ibtehaz, Nabil, Yan, Ning, Mortazavi, Masood, Kihara, Daisuke
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

ACC-ViT : Atrous Convolution's Comeback in Vision Transformers
by: Ibtehaz, Nabil, et al.
Published: (2024)

Modally Reduced Representation Learning of Multi-Lead ECG Signals through Simultaneous Alignment and Reconstruction
by: Ibtehaz, Nabil, et al.
Published: (2024)

Multimodal joint prediction of traffic spatial-temporal data with graph sparse attention mechanism and bidirectional temporal convolutional network
by: Zhang, Dongran, et al.
Published: (2024)

A Novel Vision Transformer with Residual in Self-attention for Biomedical Image Classification
by: Sharma, Arun K., et al.
Published: (2023)

Boundary-Aware Vision Transformer for Angiography Vascular Network Segmentation
by: Hezil, Nabil, et al.
Published: (2025)

GeminiFusion: Efficient Pixel-wise Multimodal Fusion for Vision Transformer
by: Jia, Ding, et al.
Published: (2024)

CAS-ViT: Convolutional Additive Self-attention Vision Transformers for Efficient Mobile Applications
by: Zhang, Tianfang, et al.
Published: (2024)

Block-based Symmetric Pruning and Fusion for Efficient Vision Transformers
by: Hsieh, Yi-Kuan, et al.
Published: (2025)

WS-DETR: Robust Water Surface Object Detection through Vision-Radar Fusion with Detection Transformer
by: Yin, Huilin, et al.
Published: (2025)

On the Faithfulness of Vision Transformer Explanations
by: Wu, Junyi, et al.
Published: (2024)

Fusion of Foundation and Vision Transformer Model Features for Dermatoscopic Image Classification
by: Mahbod, Amirreza, et al.
Published: (2025)

Multi-SIGATnet: A multimodal schizophrenia MRI classification algorithm using sparse interaction mechanisms and graph attention networks
by: Jiao, Yuhong, et al.
Published: (2024)

Iwin Transformer: Hierarchical Vision Transformer using Interleaved Windows
by: Huo, Simin, et al.
Published: (2025)

Sparse Transformer for Ultra-sparse Sampled Video Compressive Sensing
by: Cao, Miao, et al.
Published: (2025)

Multi-modal and Multi-view Fundus Image Fusion for Retinopathy Diagnosis via Multi-scale Cross-attention and Shifted Window Self-attention
by: Huang, Yonghao, et al.
Published: (2025)

Token Transformation Matters: Towards Faithful Post-hoc Explanation for Vision Transformer
by: Wu, Junyi, et al.
Published: (2024)

Flash Window Attention: speedup the attention computation for Swin Transformer
by: Zhang, Zhendong
Published: (2025)

Multi-criteria Token Fusion with One-step-ahead Attention for Efficient Vision Transformers
by: Lee, Sanghyeok, et al.
Published: (2024)

EVCC: Enhanced Vision Transformer-ConvNeXt-CoAtNet Fusion for Classification
by: Hasan, Kazi Reyazul, et al.
Published: (2025)

A Lightweight Convolution and Vision Transformer integrated model with Multi-scale Self-attention Mechanism
by: Zhang, Yi, et al.
Published: (2025)

FlatFusion: Delving into Details of Sparse Transformer-based Camera-LiDAR Fusion for Autonomous Driving
by: Zhu, Yutao, et al.
Published: (2024)

Vision-language models for decoding provider attention during neonatal resuscitation
by: Parodi, Felipe, et al.
Published: (2024)

Surface Normal Reconstruction Using Polarization-Unet
by: Mortazavi, F. S., et al.
Published: (2024)

Semi-MoE: Mixture-of-Experts meets Semi-Supervised Histopathology Segmentation
by: Vu, Nguyen Lan Vi, et al.
Published: (2025)

TDiR: Transformer based Diffusion for Image Restoration Tasks
by: Anwar, Abbas, et al.
Published: (2025)

Similarity Guided Multimodal Fusion Transformer for Semantic Location Prediction in Social Media
by: Zhang, Zhizhen, et al.
Published: (2024)

A Novel Vision Transformer for Camera-LiDAR Fusion based Traffic Object Segmentation
by: Tahves, Toomas, et al.
Published: (2025)

Vision Transformers with Self-Distilled Registers
by: Chen, Yinjie, et al.
Published: (2025)

Multimodal Biometric Authentication Using Camera-Based PPG and Fingerprint Fusion
by: Zheng, Xue Xian, et al.
Published: (2024)

DreamFuse: Adaptive Image Fusion with Diffusion Transformer
by: Huang, Junjia, et al.
Published: (2025)

Vox-UDA: Voxel-wise Unsupervised Domain Adaptation for Cryo-Electron Subtomogram Segmentation with Denoised Pseudo Labeling
by: Li, Haoran, et al.
Published: (2024)

Multi-modal Fusion based Q-distribution Prediction for Controlled Nuclear Fusion
by: Wang, Shiao, et al.
Published: (2024)

Similarity-Guided Layer-Adaptive Vision Transformer for UAV Tracking
by: Xue, Chaocan, et al.
Published: (2025)

ADFQ-ViT: Activation-Distribution-Friendly Post-Training Quantization for Vision Transformers
by: Jiang, Yanfeng, et al.
Published: (2024)

CAViT -- Channel-Aware Vision Transformer for Dynamic Feature Fusion
by: Safdar, Aon, et al.
Published: (2026)

Centroid-centered Modeling for Efficient Vision Transformer Pre-training
by: Yan, Xin, et al.
Published: (2023)

Multi-Contrast Fusion Module: An attention mechanism integrating multi-contrast features for fetal torso plane classification
by: Zhu, Shengjun, et al.
Published: (2025)

Vision Transformer attention alignment with human visual perception in aesthetic object evaluation
by: Carrasco, Miguel, et al.
Published: (2025)

Multimodal Transformer Using Cross-Channel attention for Object Detection in Remote Sensing Images
by: Bahaduri, Bissmella, et al.
Published: (2023)

CNNs, Transformers, Hybrid, and Vision Language Models for Skin Cancer Detection
by: Dey, Durjoy, et al.
Published: (2026)