Cover Image

Critical attention scaling in long-context transformers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Shi, Lin, Zhengjiang, Polyanskiy, Yury, Rigollet, Philippe
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Discrete Mathematics Classical Analysis and ODEs
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Rado's covering problem for cubes and balls: a semi-survey
by: Dall'Ara, Gian Maria, et al.
Published: (2026)

Fast Convergence for High-Order ODE Solvers in Diffusion Probabilistic Models
by: Huang, Daniel Zhengyu, et al.
Published: (2025)

Convergence Analysis of Probability Flow ODE for Score-based Generative Models
by: Huang, Daniel Zhengyu, et al.
Published: (2024)

Las funciones booleans y el lema de Bonami
by: González, María José, et al.
Published: (2025)

Whispering Gallery Modes for Semilinear Dirichlet Eigenvalue Problems
by: Lin, Zhengjiang
Published: (2026)

Quantitative Clustering in Mean-Field Transformer Models
by: Chen, Shi, et al.
Published: (2025)

Le Roy, Lerch and Legendre chi functions and generalised Borel-Le Roy transform
by: Dattoli, Giuseppe, et al.
Published: (2026)

Monodromy of generalized Lame equations with Darboux-Treibich-Verdier potentials: A universal law
by: Chen, Zhijie, et al.
Published: (2024)

Scaling Limits of Long-Context Transformers
by: Bruno, Giuseppe, et al.
Published: (2026)

Dynamical localization and eigenvalue asymptotics: long-range hopping lattice operators with electric field
by: Aloisio, M.
Published: (2025)

Deformations of OP ensembles in a bulk critical scaling
by: Candido, Caio E., et al.
Published: (2025)

Provable wavelet-based neural approximation
by: Hur, Youngmi, et al.
Published: (2025)

Constitutive properties for isotropic energies in ideal nonlinear elasticity for solid materials: numerical evidences for invertibility and monotonicity in different stress-strain pairs
by: Ghiba, Ionel-Dumitrel, et al.
Published: (2025)

Linearization of Newton's second law
by: Paliathanasis, Andronikos
Published: (2024)

Symmetry criteria for the equality of interior and exterior shape factors
by: McKee, Kyle, et al.
Published: (2024)

Further evidence towards the Fourier Entropy-Influence conjecture
by: González, María José, et al.
Published: (2026)

Generalized Jensen's inequality motivated from thermodynamics
by: Banerjee, Gourav
Published: (2025)

Spectral Criteria for Unique Signal Recovery from Two-Sided Sampling
by: Szehr, Oleg
Published: (2025)

Open problems UP24
by: Manskova, Maryna
Published: (2025)

Reviewing the Helmholtz Equation on Euclidean Plane and Interbasis Expansions
by: Pogosyan, G. S., et al.
Published: (2025)

Connection formulae for the radial Toda equations II
by: Guest, Martin A., et al.
Published: (2025)

Recurrence relations and the Christoffel-Darboux formula for elliptic orthogonal polynomials
by: Desiraju, Harini, et al.
Published: (2025)

Elliptic asymptotic behaviour of $q$-Painlevé transcendents
by: Holroyd, Joshua
Published: (2025)

Two-Point Vortex Confinement in a simply connected domain
by: Ibrahim, Slim, et al.
Published: (2025)

A class of Truncated Freud polynomials
by: García-Ardila, Juan Carlos, et al.
Published: (2025)

Meta Algebras and Special Functions: the Racah Case
by: Crampé, Nicolas, et al.
Published: (2026)

A proof of Saari's homographic conjecture
by: Tibboel, Pieter
Published: (2022)

Determinantally equivalent nonzero functions
by: Mantelos, Harry Sapranidis
Published: (2023)

On zero behavior of higher-order Sobolev-type discrete q-Hermite I orthogonal polynomials
by: Huertas, Edmundo J., et al.
Published: (2024)

Circles in diffraction
by: Korfanty, Emily R., et al.
Published: (2024)

Inverse scattering problem for third order differential operators on the whole axis
by: Zolotarev, V. A.
Published: (2024)

A Szegő Limit Theorem Related to the Hilbert Matrix
by: Otte, Peter
Published: (2022)

Construction of a transmutation for the one-dimensional Schrödinger operator and a representation for solutions
by: Kravchenko, Vladislav V.
Published: (2016)

Representations of solutions of time-fractional multi-order systems of differential-operator equations
by: Umarov, Sabir
Published: (2024)

Connecting Exceptional Orthogonal Polynomials of Different Kind
by: Quesne, Christiane
Published: (2023)

Semiclassical resonances for matrix Schrödinger operators with vanishing interactions at crossings of classical trajectories
by: Louatron, Vincent
Published: (2023)

An inverse problem in Polya-Schur theory. I. Non-genegerate and degenerate operators
by: Alexandersson, Per, et al.
Published: (2024)

A family of polylogarithmic integrals
by: Sofo, Anthony, et al.
Published: (2024)

Strong Szegő Limit Theorems for Multi-Bordered, Framed, and Multi-Framed Toeplitz Determinants
by: Gharakhloo, Roozbeh
Published: (2023)

Umbral theory and the algebra of formal power series
by: Ricci, Roberto
Published: (2026)