Image de couverture de livre

Linear Memory SE(2) Invariant Attention

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Pronovost, Ethan, Boloor, Neha, Schleede, Peter, Hendy, Noureldin, Morales, Andres, Roy, Nicholas
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

RDAR: Reward-Driven Agent Relevance Estimation for Autonomous Driving
par: Bosio, Carlo, et autres
Publié: (2025)

Robust Intervention Learning from Emergency Stop Interventions
par: Pronovost, Ethan, et autres
Publié: (2026)

Foundation Models for Rapid Autonomy Validation
par: Farid, Alec, et autres
Publié: (2024)

Flash Invariant Point Attention
par: Liu, Andrew, et autres
Publié: (2025)

Adaptive Memory Decay for Log-Linear Attention
par: Amin, Yaxita, et autres
Publié: (2026)

GatedFWA: Linear Flash Windowed Attention with Gated Associative Memory
par: Liu, Jiaxu, et autres
Publié: (2025)

Variational Linear Attention: Stable Associative Memory for Long-Context Transformers
par: Pandey, Vishal, et autres
Publié: (2026)

A Persistent-State Dataflow Accelerator for Memory-Bound Linear Attention Decode on FPGA
par: Gupta, Neelesh, et autres
Publié: (2026)

E2Former-V2: On-the-Fly Equivariant Attention with Linear Activation Memory
par: Huang, Lin, et autres
Publié: (2026)

RAM-Net: Expressive Linear Attention with Selectively Addressable Memory
par: Xiao, Kaicheng, et autres
Publié: (2026)

Why Linear Interpretability Works: Invariant Subspaces as a Result of Architectural Constraints
par: Saurez, Andres, et autres
Publié: (2026)

TL-PCA: Transfer Learning of Principal Component Analysis
par: Hendy, Sharon, et autres
Publié: (2024)

Training Dynamics of In-Context Learning in Linear Attention
par: Zhang, Yedi, et autres
Publié: (2025)

Exact Recovery of Sparse Binary Vectors from Generalized Linear Measurements
par: Mazumdar, Arya, et autres
Publié: (2025)

Log-Linear Attention
par: Guo, Han, et autres
Publié: (2025)

Algebraic Invariants of Lightning Self-Attention
par: Alexandr, Yulia, et autres
Publié: (2026)

Attend Locally, Remember Linearly: Linear Attention as Cross-Frame Memory for Autoregressive Video Diffusion
par: Li, Kunyang, et autres
Publié: (2026)

SE-GA: Memory-Augmented Self-Evolution for GUI Agents
par: Jin, Shilong, et autres
Publié: (2026)

One Pass, Any Order: Position-Invariant Listwise Reranking for LLM-Based Recommendation
par: Bito, Ethan, et autres
Publié: (2026)

Normal Guidance is what Attention Needs
par: Harvey, Ethan, et autres
Publié: (2026)

ELSA: Exact Linear-Scan Attention for Fast and Memory-Light Vision Transformers
par: Hsu, Chih-Chung, et autres
Publié: (2026)

Learning-Enhanced Observer for Linear Time-Invariant Systems with Parametric Uncertainty
par: Shu, Hao
Publié: (2025)

On the Invariants of Softmax Attention
par: Lee, Wonsuk
Publié: (2026)

Cottention: Linear Transformers With Cosine Attention
par: Mongaras, Gabriel, et autres
Publié: (2024)

Exact Linear Attention
par: Ou, Weinuo
Publié: (2026)

Kaczmarz Linear Attention
par: Zou, Jiaxuan, et autres
Publié: (2026)

Power-based Partial Attention: Bridging Linear-Complexity and Full Attention
par: Huang, Yufeng
Publié: (2026)

Why Softmax Attention Outperforms Linear Attention
par: Deng, Yichuan, et autres
Publié: (2023)

SPIN: SE(3)-Invariant Physics Informed Network for Binding Affinity Prediction
par: Choi, Seungyeon, et autres
Publié: (2024)

GIST: Gauge-Invariant Spectral Transformers for Scalable Graph Neural Operators
par: Rigotti, Mattia, et autres
Publié: (2026)

On Difficulties of Attention Factorization through Shared Memory
par: Yorsh, Uladzislau, et autres
Publié: (2024)

Federated Linear Contextual Bandits with Heterogeneous Clients
par: Blaser, Ethan, et autres
Publié: (2024)

Local Linear Attention: An Optimal Interpolation of Linear and Softmax Attention For Test-Time Regression
par: Zuo, Yifei, et autres
Publié: (2025)

Transolver is a Linear Transformer: Revisiting Physics-Attention through the Lens of Linear Attention
par: Hu, Wenjie, et autres
Publié: (2025)

Degrees of Freedom for Linear Attention: Distilling Softmax Attention with Optimal Feature Efficiency
par: Nishikawa, Naoki, et autres
Publié: (2025)

InAttention: Linear Context Scaling for Transformers
par: Eisner, Joseph
Publié: (2024)

SEA: Sparse Linear Attention with Estimated Attention Mask
par: Lee, Heejun, et autres
Publié: (2023)

Linear Attention Sequence Parallelism
par: Sun, Weigao, et autres
Publié: (2024)

Invariant Probabilistic Prediction
par: Henzi, Alexander, et autres
Publié: (2023)

Sharp Capacity Thresholds in Linear Associative Memory: From Winner-Take-All to Listwise Retrieval
par: Barnfield, Nicholas, et autres
Publié: (2026)