Image de couverture de livre

Linear Attention with Global Context: A Multipole Attention Mechanism for Vision and Physics

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Colagrande, Alex, Caillon, Paul, Feillet, Eva, Allauzen, Alexandre
Format:	Preprint
Publié:	2025
Sujets:	Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Limits of Resolution Equivariance in Fourier Neural Operators
par: Colagrande, Alex, et autres
Publié: (2026)

Recommendation of data-free class-incremental learning algorithms by simulating future data
par: Feillet, Eva, et autres
Publié: (2024)

Forward Only Learning for Orthogonal Neural Networks of any Depth
par: Caillon, Paul, et autres
Publié: (2025)

HierSum: A Global and Local Attention Mechanism for Video Summarization
par: Beedu, Apoorva, et autres
Publié: (2025)

T-TAME: Trainable Attention Mechanism for Explaining Convolutional Networks and Vision Transformers
par: Ntrougkas, Mariano V., et autres
Publié: (2024)

Class-Discriminative Attention Maps for Vision Transformers
par: Brocki, Lennart, et autres
Publié: (2023)

FasterViT: Fast Vision Transformers with Hierarchical Attention
par: Hatamizadeh, Ali, et autres
Publié: (2023)

SLA2: Sparse-Linear Attention with Learnable Routing and QAT
par: Zhang, Jintao, et autres
Publié: (2026)

Test-Time Training with KV Binding Is Secretly Linear Attention
par: Liu, Junchen, et autres
Publié: (2026)

GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformers
par: Miyato, Takeru, et autres
Publié: (2023)

Fairness-aware Vision Transformer via Debiased Self-Attention
par: Qiang, Yao, et autres
Publié: (2023)

COMCAT: Towards Efficient Compression and Customization of Attention-Based Vision Models
par: Xiao, Jinqi, et autres
Publié: (2023)

The Loupe: A Plug-and-Play Attention Module for Amplifying Discriminative Features in Vision Transformers
par: Sengodan, Naren
Publié: (2025)

SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse-Linear Attention
par: Zhang, Jintao, et autres
Publié: (2025)

MoH: Multi-Head Attention as Mixture-of-Head Attention
par: Jin, Peng, et autres
Publié: (2024)

Generalized Neighborhood Attention: Multi-dimensional Sparse Attention at the Speed of Light
par: Hassani, Ali, et autres
Publié: (2025)

Mitigating Object Hallucinations in Vision-Language Models through Region-Aware Attention Recalibration
par: Xu, Yuanzhi, et autres
Publié: (2026)

Interpreting Attention Heads for Image-to-Text Information Flow in Large Vision-Language Models
par: Kim, Jinyeong, et autres
Publié: (2025)

IBiT: Utilizing Inductive Biases to Create a More Data Efficient Attention Mechanism
par: Giri, Adithya
Publié: (2025)

Voila-A: Aligning Vision-Language Models with User's Gaze Attention
par: Yan, Kun, et autres
Publié: (2023)

Attention in Diffusion Model: A Survey
par: Hua, Litao, et autres
Publié: (2025)

Fast Training of Recurrent Neural Networks with Stationary State Feedbacks
par: Caillon, Paul, et autres
Publié: (2025)

Where Reliability Lives in Vision-Language Models: A Mechanistic Study of Attention, Hidden States, and Causal Circuits
par: Mann, Logan, et autres
Publié: (2026)

On the Surprising Effectiveness of Attention Transfer for Vision Transformers
par: Li, Alexander C., et autres
Publié: (2024)

Faster Neighborhood Attention: Reducing the O(n^2) Cost of Self Attention at the Threadblock Level
par: Hassani, Ali, et autres
Publié: (2024)

Not All Attention Heads Are What You Need: Refining CLIP's Image Representation with Attention Ablation
par: Lin, Feng, et autres
Publié: (2025)

PCaM: A Progressive Focus Attention-Based Information Fusion Method for Improving Vision Transformer Domain Adaptation
par: Zang, Zelin, et autres
Publié: (2025)

Radial Attention: $O(n\log n)$ Sparse Attention with Energy Decay for Long Video Generation
par: Li, Xingyang, et autres
Publié: (2025)

Adaptive Prompt Tuning: Vision Guided Prompt Tuning with Cross-Attention for Fine-Grained Few-Shot Learning
par: Brouwer, Eric, et autres
Publié: (2024)

MimiQ: Low-Bit Data-Free Quantization of Vision Transformers with Encouraging Inter-Head Attention Similarity
par: Choi, Kanghyun, et autres
Publié: (2024)

Deep Attention-guided Adaptive Subsampling
par: Shankaranarayana, Sharath M, et autres
Publié: (2025)

ENA: Efficient N-dimensional Attention
par: Zhong, Yibo
Publié: (2025)

MAIS: Memory-Attention for Interactive Segmentation
par: Orbes-Arteaga, Mauricio, et autres
Publié: (2025)

The Linear Attention Resurrection in Vision Transformer
par: Zheng, Chuanyang
Publié: (2025)

EDNet: Edge-Optimized Small Target Detection in UAV Imagery -- Faster Context Attention, Better Feature Fusion, and Hardware Acceleration
par: Song, Zhifan, et autres
Publié: (2025)

Elliptical Attention
par: Nielsen, Stefan K., et autres
Publié: (2024)

Shape-Guided Diffusion with Inside-Outside Attention
par: Park, Dong Huk, et autres
Publié: (2022)

Motion meets Attention: Video Motion Prompts
par: Chen, Qixiang, et autres
Publié: (2024)

Efficient Image Generation with Variadic Attention Heads
par: Walton, Steven, et autres
Publié: (2022)

DiffCLIP: Differential Attention Meets CLIP
par: Hammoud, Hasan Abed Al Kader, et autres
Publié: (2025)