Cover Image

Algebraic Invariants of Lightning Self-Attention

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Alexandr, Yulia, Duan, Hao, Montúfar, Guido
Format:	Preprint
Published:	2026
Subjects:	Algebraic Geometry Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Robustness Verification of Polynomial Neural Networks
by: Alexandr, Yulia, et al.
Published: (2026)

Constraining the outputs of ReLU neural networks
by: Alexandr, Yulia, et al.
Published: (2025)

Geometry of Lightning Self-Attention: Identifiability and Dimension
by: Henry, Nathan W., et al.
Published: (2024)

The Symmetries of Three-Layer ReLU Networks
by: Gegenfurtner, Johanna Marie, et al.
Published: (2026)

Critical Points of Degenerate Metrics on Algebraic Varieties: A Tale of Overparametrization
by: Marchetti, Giovanni Luca, et al.
Published: (2025)

Algebraic Magnetism Invariants of Self-Actions of Diagonalizable Monoid Schemes
by: Mayeux, Arnaud
Published: (2025)

Covering Number of Real Algebraic Varieties and Beyond: Improved Bounds and Applications
by: Zhang, Yifan, et al.
Published: (2023)

Approximate Fiber Product: A Preliminary Algebraic-Geometric Perspective on Multimodal Embedding Alignment
by: Zhao, Dongfang
Published: (2024)

Tropical Attention: Neural Algorithmic Reasoning for Combinatorial Algorithms
by: Hashemi, Baran, et al.
Published: (2025)

Attention Is Not What You Need
by: Chong, Zhang
Published: (2025)

Mixtures of Discrete Decomposable Graphical Models
by: Alexandr, Yulia, et al.
Published: (2024)

Simple Linear Loops: Algebraic Invariants and Applications
by: Manssour, Rida Ait El, et al.
Published: (2024)

Minimal Filling Architectures of Polynomial Neural Networks: Counterexamples, Frontier Search, and Defects
by: Dao, Kevin, et al.
Published: (2026)

Causal Representation Meets Stochastic Modeling under Generic Geometry
by: Ren, Jiaxu, et al.
Published: (2026)

CrossADR: enhancing adverse drug reactions prediction for combination pharmacotherapy with cross-layer feature integration and cross-level associative learning
by: Cheung, Y.
Published: (2026)

Strategic PAC Learnability via Geometric Definability
by: Filmus, Yuval, et al.
Published: (2026)

The Geometry of Polynomial Group Convolutional Neural Networks
by: Hendi, Yacoub, et al.
Published: (2026)

On the Geometry and Optimization of Polynomial Convolutional Networks
by: Shahverdi, Vahid, et al.
Published: (2024)

Toric geometry of ReLU neural networks
by: Fu, Yaoying
Published: (2025)

Computations and ML for surjective rational maps
by: Karzhemanov, Ilya
Published: (2025)

The Riemannian Geometry Associated to Gradient Flows of Linear Convolutional Networks
by: Achour, El Mehdi, et al.
Published: (2025)

Algebra Unveils Deep Learning -- An Invitation to Neuroalgebraic Geometry
by: Marchetti, Giovanni Luca, et al.
Published: (2025)

Learning on a Razor's Edge: Identifiability and Singularity of Polynomial Neural Networks
by: Shahverdi, Vahid, et al.
Published: (2025)

Can Transformers Do Enumerative Geometry?
by: Hashemi, Baran, et al.
Published: (2024)

Geometry of Linear Neural Networks: Equivariance and Invariance under Permutation Groups
by: Kohn, Kathlén, et al.
Published: (2023)

TokenBlowUp: Resolving Representational Singularities in LLM Token Spaces via Monoidal Transformations
by: Zhao, Dongfang
Published: (2025)

Tropical Expressivity of Neural Networks
by: Lezeau, Paul, et al.
Published: (2024)

TopoGeoScore: A Self-Supervised Source-Only Geometric Framework for OOD Checkpoint Selection
by: Hazratian, Farid, et al.
Published: (2026)

Invariant Algebraic $D$-Modules on Connected Reductive Groups
by: Kashyap, Rudrendra, et al.
Published: (2026)

The twistor space of a compact hypercomplex manifold is never Moishezon
by: Gorginyan, Yulia
Published: (2024)

Algebraic Tools for Computing Polynomial Loop Invariants
by: Bayarmagnai, Erdenebayar, et al.
Published: (2024)

On Higher-Order Geometric Refinements of Classical Covariance Asymptotics: An Approach via Intrinsic and Extrinsic Information Geometry
by: Amir, Malik, et al.
Published: (2026)

Testing the variety hypothesis
by: Lerario, A., et al.
Published: (2025)

Algebraic and Algorithmic Methods for Computing Polynomial Loop Invariants
by: Bayarmagnai, Erdenebayar, et al.
Published: (2024)

Algebraic normalisation
by: Białożyt, Adam
Published: (2025)

Algebraic Magnetism
by: Mayeux, Arnaud
Published: (2022)

Reinforcement Learning for Power-Flow Network Analysis
by: Ergur, Alperen, et al.
Published: (2026)

Geometry-Aware Simplicial Message Passing
by: Wang, Elena Xinyi, et al.
Published: (2026)

PHLP: Sole Persistent Homology for Link Prediction - Interpretable Feature Extraction
by: You, Junwon, et al.
Published: (2024)

Persistent Homology as Stopping-Criterion for Voronoi Interpolation
by: Melodia, Luciano, et al.
Published: (2019)