Cover Image

A mathematical perspective on Transformers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Geshkovski, Borjan, Letrouit, Cyril, Polyanskiy, Yury, Rigollet, Philippe
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Analysis of PDEs Dynamical Systems
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The emergence of clusters in self-attention dynamics
by: Geshkovski, Borjan, et al.
Published: (2023)

Dynamic metastability in the self-attention model
by: Geshkovski, Borjan, et al.
Published: (2024)

Quantitative Clustering in Mean-Field Transformer Models
by: Chen, Shi, et al.
Published: (2025)

Synchronization of mean-field models on the circle
by: Polyanskiy, Yury, et al.
Published: (2025)

Clustering in Causal Attention Masking
by: Karagodin, Nikita, et al.
Published: (2024)

Kinetic theory for Transformers and the lost-in-the-middle phenomenon
by: Duerinckx, Mitia, et al.
Published: (2026)

Constructive conditional normalizing flows
by: Geshkovski, Borjan, et al.
Published: (2026)

Homogenized Transformers
by: Koubbi, Hugo, et al.
Published: (2026)

Residual connections provably mitigate oversmoothing in graph neural networks
by: Chen, Ziang, et al.
Published: (2025)

Measure-to-measure interpolation using Transformers
by: Geshkovski, Borjan, et al.
Published: (2024)

The Mean-Field Dynamics of Transformers
by: Rigollet, Philippe
Published: (2025)

On the number of modes of Gaussian kernel density estimators
by: Geshkovski, Borjan, et al.
Published: (2024)

Latent Space Element Method
by: Chung, Seung Whan, et al.
Published: (2026)

Information theory and discriminative sampling for model discovery
by: Bao, Yuxuan, et al.
Published: (2025)

Smooth Piecewise Cutting for Neural Operator to Handle Discontinuities and Sharp Transitions
by: Dang, Ha, et al.
Published: (2026)

An analysis of protesting activity and trauma through mathematical and statistical models
by: Rodriguez, Nancy, et al.
Published: (2023)

Universality of almost periodic orbits in certain composite functions
by: Nakayama, Chikara, et al.
Published: (2023)

Adaptive control of reaction-diffusion PDEs via neural operator-approximated gain kernels
by: Bhan, Luke, et al.
Published: (2024)

Quantifying Concentration Phenomena of Mean-Field Transformers in the Low-Temperature Regime
by: Alcalde, Albert, et al.
Published: (2026)

Rigorous computation of solutions of semi-linear PDEs on unbounded domains via spectral methods
by: Cadiot, Matthieu, et al.
Published: (2023)

Stationary non-radial localized patterns in the planar Swift-Hohenberg PDE: constructive proofs of existence
by: Cadiot, Matthieu, et al.
Published: (2024)

Computer-Assisted Proofs of Gap Solitons in Bose-Einstein Condensates
by: Ayala, Miguel, et al.
Published: (2025)

Periodic localized traveling waves in the two-dimensional suspension bridge equation
by: van der Aalst, Lindsey, et al.
Published: (2024)

YuriiFormer: A Suite of Nesterov-Accelerated Transformers
by: Zimin, Aleksandr, et al.
Published: (2026)

Gluing methods for quantitative stability of optimal transport maps
by: Letrouit, Cyril, et al.
Published: (2024)

Symbolic--KAN: Kolmogorov-Arnold Networks with Discrete Symbolic Structure for Interpretable Learning
by: Faroughi, Salah A, et al.
Published: (2026)

Critical attention scaling in long-context transformers
by: Chen, Shi, et al.
Published: (2025)

Plankton-Oxygen Dynamics in the Context of Climate Change: A Fractional Model with A Probability Density Function Approach
by: El-Borai, Mahmoud M., et al.
Published: (2025)

A note on two Collatz evolution flows
by: Alegría, Francisco, et al.
Published: (2025)

A mathematical model for the Einstein-Podolsky-Rosen argument
by: Adami, Riccardo, et al.
Published: (2026)

A new selection problem for degenerate viscous Hamilton-Jacobi equations
by: Chen, Qinbo, et al.
Published: (2026)

A Birkhoff Normal Form Theorem for Partial Differential Equations on torus
by: Liu, Jianjun, et al.
Published: (2024)

Strange Attractors in Fractional Differential Equations: A Topological Approach to Chaos and Stability
by: Katende, Ronald
Published: (2024)

Resolving Sharp Gradients of Unstable Singularities to Machine Precision via Neural Networks
by: Wang, Yongji, et al.
Published: (2025)

A dispersive effective equation for transverse propagation of planar shallow water waves over periodic bathymetry
by: Ketcheson, David I., et al.
Published: (2024)

Global viscosity solutions to Lorentzian eikonal equation on globally hyperbolic space-times
by: Zhu, Siyao, et al.
Published: (2023)

Global solution and blow-up for the SKT model in Population Dynamics
by: Belkhamsa, Ichraf, et al.
Published: (2023)

Continuum limit for interacting systems on adaptive networks
by: Throm, Sebastian
Published: (2023)

Quantized vortex dynamics of the complex Ginzburg-Landau equation on torus
by: Zhu, Yongxing
Published: (2023)

Generic alignment conjecture for systems of Cucker-Smale type
by: Shvydkoy, Roman
Published: (2023)