Cover Image

There is More to Attention: Statistical Filtering Enhances Explanations in Vision Transformers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ayyar, Meghna P, Benois-Pineau, Jenny, Zemmari, Akka
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

FusWay: Multimodal hybrid fusion approach. Application to Railway Defect Detection
by: Zhukov, Alexey, et al.
Published: (2025)

Locating Demographic Bias at the Attention-Head Level in CLIP's Vision Encoder
by: Yasser, Alaa, et al.
Published: (2026)

Identifying Surgical Instruments in Laparoscopy Using Deep Learning Instance Segmentation
by: Kletz, Sabrina, et al.
Published: (2025)

Object segmentation in the wild with foundation models: application to vision assisted neuro-prostheses for upper limbs
by: Atoki, Bolutife, et al.
Published: (2025)

Mean Opinion Score as a New Metric for User-Evaluation of XAI Methods
by: Yu, Hyeon, et al.
Published: (2024)

Speed-up of Vision Transformer Models by Attention-aware Token Filtering
by: Naruko, Takahiro, et al.
Published: (2025)

On the Faithfulness of Vision Transformer Explanations
by: Wu, Junyi, et al.
Published: (2024)

Attention Guided CAM: Visual Explanations of Vision Transformer Guided by Self-Attention
by: Leem, Saebom, et al.
Published: (2024)

Patch Pruning Strategy Based on Robust Statistical Measures of Attention Weight Diversity in Vision Transformers
by: Igaue, Yuki, et al.
Published: (2025)

Vision Transformers Need More Than Registers
by: Shi, Cheng, et al.
Published: (2026)

Representative Attention For Vision Transformers
by: Li, Yuntong, et al.
Published: (2026)

Vision Transformers with Hierarchical Attention
by: Liu, Yun, et al.
Published: (2021)

Hypergraph Vision Transformers: Images are More than Nodes, More than Edges
by: Fixelle, Joshua
Published: (2025)

Token Transformation Matters: Towards Faithful Post-hoc Explanation for Vision Transformer
by: Wu, Junyi, et al.
Published: (2024)

ReViT: Enhancing Vision Transformers Feature Diversity with Attention Residual Connections
by: Diko, Anxhelo, et al.
Published: (2024)

Vision Transformers are Circulant Attention Learners
by: Han, Dongchen, et al.
Published: (2025)

Structured Initialization for Attention in Vision Transformers
by: Zheng, Jianqiao, et al.
Published: (2024)

Multi-manifold Attention for Vision Transformers
by: Konstantinidis, Dimitrios, et al.
Published: (2022)

HAViT: Historical Attention Vision Transformer
by: Banik, Swarnendu, et al.
Published: (2026)

FViT: A Focal Vision Transformer with Gabor Filter
by: Shi, Yulong, et al.
Published: (2024)

MABViT -- Modified Attention Block Enhances Vision Transformers
by: Ramesh, Mahesh, et al.
Published: (2023)

Less is More: Discovering Concise Network Explanations
by: Kondapaneni, Neehar, et al.
Published: (2024)

Multi-dimension Transformer with Attention-based Filtering for Medical Image Segmentation
by: Wang, Wentao, et al.
Published: (2024)

Polyline Path Masked Attention for Vision Transformer
by: Zhao, Zhongchen, et al.
Published: (2025)

BinaryAttention: One-Bit QK-Attention for Vision and Diffusion Transformers
by: Xiao, Chaodong, et al.
Published: (2026)

Inpainting the Gaps: A Novel Framework for Evaluating Explanation Methods in Vision Transformers
by: Badisa, Lokesh, et al.
Published: (2024)

Learning Visual Prompts for Guiding the Attention of Vision Transformers
by: Rezaei, Razieh, et al.
Published: (2024)

Decision-Aware Attention Propagation for Vision Transformer Explainability
by: Jo, Sehyeong, et al.
Published: (2026)

StegaVision: Enhancing Steganography with Attention Mechanism
by: Kumar, Abhinav, et al.
Published: (2024)

AdaNCA: Neural Cellular Automata As Adaptors For More Robust Vision Transformer
by: Xu, Yitao, et al.
Published: (2024)

SVD-ViT: Does SVD Make Vision Transformers Attend More to the Foreground?
by: Murata, Haruhiko, et al.
Published: (2026)

STEAM: Squeeze and Transform Enhanced Attention Module
by: Sabharwal, Rishabh, et al.
Published: (2024)

Artifacts and Attention Sinks: Structured Approximations for Efficient Vision Transformers
by: Lu, Andrew, et al.
Published: (2025)

S2AFormer: Strip Self-Attention for Efficient Vision Transformer
by: Xu, Guoan, et al.
Published: (2025)

Calibration Attention: Learning Reliability-Aware Representations for Vision Transformers
by: Liang, Wenhao, et al.
Published: (2025)

ToSA: Token Selective Attention for Efficient Vision Transformers
by: Singh, Manish Kumar, et al.
Published: (2024)

SimA: Simple Softmax-free Attention for Vision Transformers
by: Koohpayegani, Soroush Abbasi, et al.
Published: (2022)

EViT: An Eagle Vision Transformer with Bi-Fovea Self-Attention
by: Shi, Yulong, et al.
Published: (2023)

ViT-AdaLA: Adapting Vision Transformers with Linear Attention
by: Li, Yifan, et al.
Published: (2026)

LookHere: Vision Transformers with Directed Attention Generalize and Extrapolate
by: Fuller, Anthony, et al.
Published: (2024)