:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Saxena, Krati, Ruiz, Federico Jurado, Manzi, Guido, Liu, Dianbo, Lamb, Alex
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence Machine Learning
Online Access:	https://arxiv.org/abs/2509.16058
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

GraphDiffMed: Knowledge-Constrained Differential Attention with Pharmacological Graph Priors for Medication Recommendation
by: Saxena, Krati, et al.
Published: (2026)

Testing Components of the Attention Schema Theory in Artificial Neural Networks
by: Farrell, Kathryn T., et al.
Published: (2024)

Eigen Attention: Attention in Low-Rank Space for KV Cache Compression
by: Saxena, Utkarsh, et al.
Published: (2024)

Unveiling and Controlling Anomalous Attention Distribution in Transformers
by: Yan, Ruiqing, et al.
Published: (2024)

Transolver is a Linear Transformer: Revisiting Physics-Attention through the Lens of Linear Attention
by: Hu, Wenjie, et al.
Published: (2025)

Geometric Attention: A Regime-Explicit Operator Semantics for Transformer Attention
by: Freytes, Luis Rosario
Published: (2026)

XicorAttention: Time Series Transformer Using Attention with Nonlinear Correlation
by: Kimura, Daichi, et al.
Published: (2025)

Vectorized Attention with Learnable Encoding for Quantum Transformer
by: Guo, Ziqing, et al.
Published: (2025)

The Bayesian Geometry of Transformer Attention
by: Agarwal, Naman, et al.
Published: (2025)

Attention Sinks and Outliers in Attention Residuals
by: Luo, Haozheng, et al.
Published: (2026)

vAttention: Verified Sparse Attention
by: Desai, Aditya, et al.
Published: (2025)

DashAttention: Differentiable and Adaptive Sparse Hierarchical Attention
by: Huang, Yuxiang, et al.
Published: (2026)

Budgeted Attention Allocation: Cost-Conditioned Compute Control for Efficient Transformers
by: Nidhi, Amrit
Published: (2026)

Selective Attention Improves Transformer
by: Leviathan, Yaniv, et al.
Published: (2024)

Exact Attention Sensitivity and the Geometry of Transformer Stability
by: Emadi, Seyed Morteza
Published: (2026)

Graph Convolutions Enrich the Self-Attention in Transformers!
by: Choi, Jeongwhan, et al.
Published: (2023)

Higher-Order Transformers With Kronecker-Structured Attention
by: Omranpour, Soroush, et al.
Published: (2024)

Expanding Expressivity in Transformer Models with MöbiusAttention
by: Halacheva, Anna-Maria, et al.
Published: (2024)

Kaczmarz Linear Attention
by: Zou, Jiaxuan, et al.
Published: (2026)

Decomposing Attention To Find Context-Sensitive Neurons
by: Gibson, Alex
Published: (2025)

INT-FlashAttention: Enabling Flash Attention for INT8 Quantization
by: Chen, Shimao, et al.
Published: (2024)

Neurocircuitry-Inspired Hierarchical Graph Causal Attention Networks for Explainable Depression Identification
by: Chen, Weidao, et al.
Published: (2025)

Nexusformer: Nonlinear Attention Expansion for Stable and Inheritable Transformer Scaling
by: Zhao, Weijie, et al.
Published: (2026)

Attention on the Sphere
by: Bonev, Boris, et al.
Published: (2025)

From Cognition to Computation: A Comparative Review of Human Attention and Transformer Architectures
by: Zhao, Minglu, et al.
Published: (2024)

CAPS: Unifying Attention, Recurrence, and Alignment in Transformer-based Time Series Forecasting
by: Pati, Viresh, et al.
Published: (2026)

SeerAttention-R: Sparse Attention Adaptation for Long Reasoning
by: Gao, Yizhao, et al.
Published: (2025)

NoiseFormer -- Noise Diffused Symmetric Attention Transformer
by: Kumar, Phani, et al.
Published: (2026)

Dispatch-Aware Ragged Attention for Pruned Vision Transformers
by: Abdellatif, Seifeldin, et al.
Published: (2026)

ZeroS: Zero-Sum Linear Attention for Efficient Transformers
by: Lu, Jiecheng, et al.
Published: (2026)

Echo State Transformer: Attention Over Finite Memories
by: Bendi-Ouis, Yannis, et al.
Published: (2025)

Strassen Attention, Split VC Dimension and Compositionality in Transformers
by: Kozachinskiy, Alexander, et al.
Published: (2025)

HATSolver: Learning Groebner Bases with Hierarchical Attention Transformers
by: Malhou, Mohamed, et al.
Published: (2025)

The Phasor Transformer: Resolving Attention Bottlenecks on the Unit Circle
by: Sigdel, Dibakar
Published: (2026)

Universal Approximation with Softmax Attention
by: Hu, Jerry Yao-Chieh, et al.
Published: (2025)

Linear Attention with Global Context: A Multipole Attention Mechanism for Vision and Physics
by: Colagrande, Alex, et al.
Published: (2025)

DistrAttention: An Efficient and Flexible Self-Attention Mechanism on Modern GPUs
by: Jin, Haolin, et al.
Published: (2025)

FlashAttention-3: Fast and Accurate Attention with Asynchrony and Low-precision
by: Shah, Jay, et al.
Published: (2024)

Robust Filter Attention: Self-Attention as Precision-Weighted State Estimation
by: Racioppo, Peter
Published: (2025)

Explore-Execute Chain: Towards an Efficient Structured Reasoning Paradigm
by: Yang, Kaisen, et al.
Published: (2025)