Algebraic Invariants of Lightning Self-Attention
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917419940839424 |
|---|---|
| author | Alexandr, Yulia Duan, Hao Montúfar, Guido |
| author_facet | Alexandr, Yulia Duan, Hao Montúfar, Guido |
| contents | We study the polynomial coefficients of lightning self-attention as coordinates of an algebraic variety. We identify linear and nonlinear families of algebraic invariants, including Chow-type, low-rank, Veronese-type, and Sylvester resultant-based constraints. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_15632 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Algebraic Invariants of Lightning Self-Attention Alexandr, Yulia Duan, Hao Montúfar, Guido Algebraic Geometry Machine Learning We study the polynomial coefficients of lightning self-attention as coordinates of an algebraic variety. We identify linear and nonlinear families of algebraic invariants, including Chow-type, low-rank, Veronese-type, and Sylvester resultant-based constraints. |
| title | Algebraic Invariants of Lightning Self-Attention |
| topic | Algebraic Geometry Machine Learning |
| url | https://arxiv.org/abs/2604.15632 |