Copertina

Attention Is Not What You Need

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Chong, Zhang
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Artificial Intelligence Algebraic Geometry
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Approximate Fiber Product: A Preliminary Algebraic-Geometric Perspective on Multimodal Embedding Alignment
di: Zhao, Dongfang
Pubblicazione: (2024)

The Shape of Adversarial Influence: Characterizing LLM Latent Spaces with Persistent Homology
di: Fay, Aideen, et al.
Pubblicazione: (2025)

Topological Signatures of ReLU Neural Network Activation Patterns
di: Bosca, Vicente, et al.
Pubblicazione: (2025)

Sum of Squares Circuits
di: Loconte, Lorenzo, et al.
Pubblicazione: (2024)

Algebraic Invariants of Lightning Self-Attention
di: Alexandr, Yulia, et al.
Pubblicazione: (2026)

Geometry of Lightning Self-Attention: Identifiability and Dimension
di: Henry, Nathan W., et al.
Pubblicazione: (2024)

Exploring the Stratified Space Structure of an RL Game with the Volume Growth Transform
di: Curry, Justin, et al.
Pubblicazione: (2025)

Attention is All You Need Until You Need Retention
di: Yaslioglu, M. Murat
Pubblicazione: (2025)

Tropical Attention: Neural Algorithmic Reasoning for Combinatorial Algorithms
di: Hashemi, Baran, et al.
Pubblicazione: (2025)

Generalized Simplicial Attention Neural Networks
di: Battiloro, Claudio, et al.
Pubblicazione: (2023)

Vulnerability Detection via Topological Analysis of Attention Maps
di: Snopov, Pavel, et al.
Pubblicazione: (2024)

Optimisation Is Not What You Need
di: Ibias, Alfredo
Pubblicazione: (2025)

A Sheaf-Theoretic and Topological Perspective on Complex Network Modeling and Attention Mechanisms in Graph Neural Models
di: Hu, Chuan-Shen
Pubblicazione: (2026)

Polynomial, trigonometric, and tropical activations
di: Khalfaoui-Hassani, Ismail, et al.
Pubblicazione: (2025)

Element-wise Attention Is All You Need
di: Feng, Guoxin
Pubblicazione: (2025)

Constraining the outputs of ReLU neural networks
di: Alexandr, Yulia, et al.
Pubblicazione: (2025)

Critical Points of Degenerate Metrics on Algebraic Varieties: A Tale of Overparametrization
di: Marchetti, Giovanni Luca, et al.
Pubblicazione: (2025)

Toric geometry of ReLU neural networks
di: Fu, Yaoying
Pubblicazione: (2025)

Computations and ML for surjective rational maps
di: Karzhemanov, Ilya
Pubblicazione: (2025)

The Riemannian Geometry Associated to Gradient Flows of Linear Convolutional Networks
di: Achour, El Mehdi, et al.
Pubblicazione: (2025)

Algebra Unveils Deep Learning -- An Invitation to Neuroalgebraic Geometry
di: Marchetti, Giovanni Luca, et al.
Pubblicazione: (2025)

Learning on a Razor's Edge: Identifiability and Singularity of Polynomial Neural Networks
di: Shahverdi, Vahid, et al.
Pubblicazione: (2025)

TokenBlowUp: Resolving Representational Singularities in LLM Token Spaces via Monoidal Transformations
di: Zhao, Dongfang
Pubblicazione: (2025)

TransMLA: Multi-Head Latent Attention Is All You Need
di: Meng, Fanxu, et al.
Pubblicazione: (2025)

Minimal Filling Architectures of Polynomial Neural Networks: Counterexamples, Frontier Search, and Defects
di: Dao, Kevin, et al.
Pubblicazione: (2026)

Causal Representation Meets Stochastic Modeling under Generic Geometry
di: Ren, Jiaxu, et al.
Pubblicazione: (2026)

On the Geometry and Optimization of Polynomial Convolutional Networks
di: Shahverdi, Vahid, et al.
Pubblicazione: (2024)

CrossADR: enhancing adverse drug reactions prediction for combination pharmacotherapy with cross-layer feature integration and cross-level associative learning
di: Cheung, Y.
Pubblicazione: (2026)

Can Transformers Do Enumerative Geometry?
di: Hashemi, Baran, et al.
Pubblicazione: (2024)

Geometry of Linear Neural Networks: Equivariance and Invariance under Permutation Groups
di: Kohn, Kathlén, et al.
Pubblicazione: (2023)

Tropical Expressivity of Neural Networks
di: Lezeau, Paul, et al.
Pubblicazione: (2024)

Strategic PAC Learnability via Geometric Definability
di: Filmus, Yuval, et al.
Pubblicazione: (2026)

Robustness Verification of Polynomial Neural Networks
di: Alexandr, Yulia, et al.
Pubblicazione: (2026)

The Geometry of Polynomial Group Convolutional Neural Networks
di: Hendi, Yacoub, et al.
Pubblicazione: (2026)

Not All Attention Heads Are What You Need: Refining CLIP's Image Representation with Attention Ablation
di: Lin, Feng, et al.
Pubblicazione: (2025)

Tensor Product Attention Is All You Need
di: Zhang, Yifan, et al.
Pubblicazione: (2025)

More Compute Is What You Need
di: Guo, Zhen
Pubblicazione: (2024)

Attention Smoothing Is All You Need For Unlearning
di: Zade, Saleh Zare, et al.
Pubblicazione: (2026)

Covering Number of Real Algebraic Varieties and Beyond: Improved Bounds and Applications
di: Zhang, Yifan, et al.
Pubblicazione: (2023)

The mechanization of science illustrated by the Lean formalization of the multi-graded Proj construction
di: Mayeux, Arnaud, et al.
Pubblicazione: (2025)