Imagen de Portada

Linear Attention with Global Context: A Multipole Attention Mechanism for Vision and Physics

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Colagrande, Alex, Caillon, Paul, Feillet, Eva, Allauzen, Alexandre
Formato:	Preprint
Publicado:	2025
Materias:	Computer Vision and Pattern Recognition Artificial Intelligence Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Limits of Resolution Equivariance in Fourier Neural Operators
por: Colagrande, Alex, et al.
Publicado: (2026)

Recommendation of data-free class-incremental learning algorithms by simulating future data
por: Feillet, Eva, et al.
Publicado: (2024)

Forward Only Learning for Orthogonal Neural Networks of any Depth
por: Caillon, Paul, et al.
Publicado: (2025)

HierSum: A Global and Local Attention Mechanism for Video Summarization
por: Beedu, Apoorva, et al.
Publicado: (2025)

T-TAME: Trainable Attention Mechanism for Explaining Convolutional Networks and Vision Transformers
por: Ntrougkas, Mariano V., et al.
Publicado: (2024)

Class-Discriminative Attention Maps for Vision Transformers
por: Brocki, Lennart, et al.
Publicado: (2023)

FasterViT: Fast Vision Transformers with Hierarchical Attention
por: Hatamizadeh, Ali, et al.
Publicado: (2023)

SLA2: Sparse-Linear Attention with Learnable Routing and QAT
por: Zhang, Jintao, et al.
Publicado: (2026)

Test-Time Training with KV Binding Is Secretly Linear Attention
por: Liu, Junchen, et al.
Publicado: (2026)

GTA: A Geometry-Aware Attention Mechanism for Multi-View Transformers
por: Miyato, Takeru, et al.
Publicado: (2023)

Fairness-aware Vision Transformer via Debiased Self-Attention
por: Qiang, Yao, et al.
Publicado: (2023)

COMCAT: Towards Efficient Compression and Customization of Attention-Based Vision Models
por: Xiao, Jinqi, et al.
Publicado: (2023)

The Loupe: A Plug-and-Play Attention Module for Amplifying Discriminative Features in Vision Transformers
por: Sengodan, Naren
Publicado: (2025)

SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse-Linear Attention
por: Zhang, Jintao, et al.
Publicado: (2025)

MoH: Multi-Head Attention as Mixture-of-Head Attention
por: Jin, Peng, et al.
Publicado: (2024)

Generalized Neighborhood Attention: Multi-dimensional Sparse Attention at the Speed of Light
por: Hassani, Ali, et al.
Publicado: (2025)

Mitigating Object Hallucinations in Vision-Language Models through Region-Aware Attention Recalibration
por: Xu, Yuanzhi, et al.
Publicado: (2026)

Interpreting Attention Heads for Image-to-Text Information Flow in Large Vision-Language Models
por: Kim, Jinyeong, et al.
Publicado: (2025)

IBiT: Utilizing Inductive Biases to Create a More Data Efficient Attention Mechanism
por: Giri, Adithya
Publicado: (2025)

Voila-A: Aligning Vision-Language Models with User's Gaze Attention
por: Yan, Kun, et al.
Publicado: (2023)

Attention in Diffusion Model: A Survey
por: Hua, Litao, et al.
Publicado: (2025)

Fast Training of Recurrent Neural Networks with Stationary State Feedbacks
por: Caillon, Paul, et al.
Publicado: (2025)

Where Reliability Lives in Vision-Language Models: A Mechanistic Study of Attention, Hidden States, and Causal Circuits
por: Mann, Logan, et al.
Publicado: (2026)

On the Surprising Effectiveness of Attention Transfer for Vision Transformers
por: Li, Alexander C., et al.
Publicado: (2024)

Faster Neighborhood Attention: Reducing the O(n^2) Cost of Self Attention at the Threadblock Level
por: Hassani, Ali, et al.
Publicado: (2024)

Not All Attention Heads Are What You Need: Refining CLIP's Image Representation with Attention Ablation
por: Lin, Feng, et al.
Publicado: (2025)

PCaM: A Progressive Focus Attention-Based Information Fusion Method for Improving Vision Transformer Domain Adaptation
por: Zang, Zelin, et al.
Publicado: (2025)

Radial Attention: $O(n\log n)$ Sparse Attention with Energy Decay for Long Video Generation
por: Li, Xingyang, et al.
Publicado: (2025)

Adaptive Prompt Tuning: Vision Guided Prompt Tuning with Cross-Attention for Fine-Grained Few-Shot Learning
por: Brouwer, Eric, et al.
Publicado: (2024)

MimiQ: Low-Bit Data-Free Quantization of Vision Transformers with Encouraging Inter-Head Attention Similarity
por: Choi, Kanghyun, et al.
Publicado: (2024)

Deep Attention-guided Adaptive Subsampling
por: Shankaranarayana, Sharath M, et al.
Publicado: (2025)

ENA: Efficient N-dimensional Attention
por: Zhong, Yibo
Publicado: (2025)

MAIS: Memory-Attention for Interactive Segmentation
por: Orbes-Arteaga, Mauricio, et al.
Publicado: (2025)

The Linear Attention Resurrection in Vision Transformer
por: Zheng, Chuanyang
Publicado: (2025)

EDNet: Edge-Optimized Small Target Detection in UAV Imagery -- Faster Context Attention, Better Feature Fusion, and Hardware Acceleration
por: Song, Zhifan, et al.
Publicado: (2025)

Elliptical Attention
por: Nielsen, Stefan K., et al.
Publicado: (2024)

Shape-Guided Diffusion with Inside-Outside Attention
por: Park, Dong Huk, et al.
Publicado: (2022)

Motion meets Attention: Video Motion Prompts
por: Chen, Qixiang, et al.
Publicado: (2024)

Efficient Image Generation with Variadic Attention Heads
por: Walton, Steven, et al.
Publicado: (2022)

DiffCLIP: Differential Attention Meets CLIP
por: Hammoud, Hasan Abed Al Kader, et al.
Publicado: (2025)