Cover Image

Attention Is Not What You Need

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Chong, Zhang
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Algebraic Geometry
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Approximate Fiber Product: A Preliminary Algebraic-Geometric Perspective on Multimodal Embedding Alignment
by: Zhao, Dongfang
Published: (2024)

The Shape of Adversarial Influence: Characterizing LLM Latent Spaces with Persistent Homology
by: Fay, Aideen, et al.
Published: (2025)

Topological Signatures of ReLU Neural Network Activation Patterns
by: Bosca, Vicente, et al.
Published: (2025)

Sum of Squares Circuits
by: Loconte, Lorenzo, et al.
Published: (2024)

Algebraic Invariants of Lightning Self-Attention
by: Alexandr, Yulia, et al.
Published: (2026)

Geometry of Lightning Self-Attention: Identifiability and Dimension
by: Henry, Nathan W., et al.
Published: (2024)

Exploring the Stratified Space Structure of an RL Game with the Volume Growth Transform
by: Curry, Justin, et al.
Published: (2025)

Attention is All You Need Until You Need Retention
by: Yaslioglu, M. Murat
Published: (2025)

Tropical Attention: Neural Algorithmic Reasoning for Combinatorial Algorithms
by: Hashemi, Baran, et al.
Published: (2025)

Generalized Simplicial Attention Neural Networks
by: Battiloro, Claudio, et al.
Published: (2023)

Vulnerability Detection via Topological Analysis of Attention Maps
by: Snopov, Pavel, et al.
Published: (2024)

Optimisation Is Not What You Need
by: Ibias, Alfredo
Published: (2025)

A Sheaf-Theoretic and Topological Perspective on Complex Network Modeling and Attention Mechanisms in Graph Neural Models
by: Hu, Chuan-Shen
Published: (2026)

Polynomial, trigonometric, and tropical activations
by: Khalfaoui-Hassani, Ismail, et al.
Published: (2025)

Element-wise Attention Is All You Need
by: Feng, Guoxin
Published: (2025)

Constraining the outputs of ReLU neural networks
by: Alexandr, Yulia, et al.
Published: (2025)

Critical Points of Degenerate Metrics on Algebraic Varieties: A Tale of Overparametrization
by: Marchetti, Giovanni Luca, et al.
Published: (2025)

Toric geometry of ReLU neural networks
by: Fu, Yaoying
Published: (2025)

Computations and ML for surjective rational maps
by: Karzhemanov, Ilya
Published: (2025)

The Riemannian Geometry Associated to Gradient Flows of Linear Convolutional Networks
by: Achour, El Mehdi, et al.
Published: (2025)

Algebra Unveils Deep Learning -- An Invitation to Neuroalgebraic Geometry
by: Marchetti, Giovanni Luca, et al.
Published: (2025)

Learning on a Razor's Edge: Identifiability and Singularity of Polynomial Neural Networks
by: Shahverdi, Vahid, et al.
Published: (2025)

TokenBlowUp: Resolving Representational Singularities in LLM Token Spaces via Monoidal Transformations
by: Zhao, Dongfang
Published: (2025)

Minimal Filling Architectures of Polynomial Neural Networks: Counterexamples, Frontier Search, and Defects
by: Dao, Kevin, et al.
Published: (2026)

Causal Representation Meets Stochastic Modeling under Generic Geometry
by: Ren, Jiaxu, et al.
Published: (2026)

On the Geometry and Optimization of Polynomial Convolutional Networks
by: Shahverdi, Vahid, et al.
Published: (2024)

CrossADR: enhancing adverse drug reactions prediction for combination pharmacotherapy with cross-layer feature integration and cross-level associative learning
by: Cheung, Y.
Published: (2026)

Can Transformers Do Enumerative Geometry?
by: Hashemi, Baran, et al.
Published: (2024)

Geometry of Linear Neural Networks: Equivariance and Invariance under Permutation Groups
by: Kohn, Kathlén, et al.
Published: (2023)

Tropical Expressivity of Neural Networks
by: Lezeau, Paul, et al.
Published: (2024)

Strategic PAC Learnability via Geometric Definability
by: Filmus, Yuval, et al.
Published: (2026)

Robustness Verification of Polynomial Neural Networks
by: Alexandr, Yulia, et al.
Published: (2026)

The Geometry of Polynomial Group Convolutional Neural Networks
by: Hendi, Yacoub, et al.
Published: (2026)

TransMLA: Multi-Head Latent Attention Is All You Need
by: Meng, Fanxu, et al.
Published: (2025)

Not All Attention Heads Are What You Need: Refining CLIP's Image Representation with Attention Ablation
by: Lin, Feng, et al.
Published: (2025)

Tensor Product Attention Is All You Need
by: Zhang, Yifan, et al.
Published: (2025)

More Compute Is What You Need
by: Guo, Zhen
Published: (2024)

Attention Smoothing Is All You Need For Unlearning
by: Zade, Saleh Zare, et al.
Published: (2026)

Covering Number of Real Algebraic Varieties and Beyond: Improved Bounds and Applications
by: Zhang, Yifan, et al.
Published: (2023)

The mechanization of science illustrated by the Lean formalization of the multi-graded Proj construction
by: Mayeux, Arnaud, et al.
Published: (2025)