Cover Image

Localmax dynamics for attention in transformers and its asymptotic behavior

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Cimetière, Henri, Chiri, Maria Teresa, Gharesifard, Bahman
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Machine Learning Dynamical Systems Optimization and Control 68T07, 68T50, 37N35, 37B25
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Tracking Finite-Time Lyapunov Exponents to Robustify Neural ODEs
by: Wöhrer, Tobias, et al.
Published: (2026)

Stability properties of Minimal Gated Unit neural networks
by: De Carli, Stefano, et al.
Published: (2026)

Chaos-Free Networks are Stable Recurrent Neural Networks
by: De Carli, Stefano, et al.
Published: (2026)

Data-driven Identification of Attractors Using Machine Learning
by: Gameiro, Marcio, et al.
Published: (2025)

Data Augmentation and Regularization for Learning Group Equivariance
by: Nordenfors, Oskar, et al.
Published: (2025)

Optimization Dynamics of Equivariant and Augmented Neural Networks
by: Nordenfors, Oskar, et al.
Published: (2023)

Terminally constrained flow-based generative models from an optimal control perspective
by: Gao, Weiguo, et al.
Published: (2026)

On existence of traveling wave of an HBV infection dynamics model: A novel approach
by: Sutradhar, Rupchand, et al.
Published: (2024)

Clustering in pure-attention hardmax transformers and its role in sentiment analysis
by: Alcalde, Albert, et al.
Published: (2024)

SympFormer: Accelerated attention blocks via Inertial Dynamics on Density Manifolds
by: Stein, Viktor, et al.
Published: (2026)

Cluster-based classification with neural ODEs via control
by: Álvarez-López, Antonio, et al.
Published: (2023)

A Learning Stability Profile for Finite-Dimensional Learning Dynamics
by: Katende, Ronald
Published: (2025)

Computational Complexity of Minimal Trap Spaces in Boolean Networks
by: Moon, Kyungduk, et al.
Published: (2022)

Phase space integrity in neural network models of Hamiltonian dynamics: A Lagrangian descriptor approach
by: Hasmi, Abrari Noor, et al.
Published: (2026)

Linear System Analysis and Optimal Control of Natural Gas Dynamics in Pipeline Networks
by: Baker, Luke S., et al.
Published: (2023)

Savanna dynamics with grazing, browsing, and migration effects
by: Chen, Chiun-Chuan, et al.
Published: (2025)

Optimization approaches to Wolbachia-based biocontrol
by: Orozco-Gonzales, Jose L., et al.
Published: (2024)

Sliding motions on systems with non-Euclidean state spaces: A differential-geometric perspective
by: Castaños, Fernando
Published: (2025)

System stabilization with policy optimization on unstable latent manifolds
by: Werner, Steffen W. R., et al.
Published: (2024)

On the Curse of Memory in Recurrent Neural Networks: Approximation and Optimization Analysis
by: Li, Zhong, et al.
Published: (2020)

Convergence, design and training of continuous-time dropout as a random batch method
by: Álvarez-López, Antonio, et al.
Published: (2025)

Rigorously Characterizing Dynamics with Machine Learning
by: Gameiro, Marcio, et al.
Published: (2025)

Learning time-scales in two-layers neural networks
by: Berthier, Raphaël, et al.
Published: (2023)

Clustering in Causal Attention Masking
by: Karagodin, Nikita, et al.
Published: (2024)

Generative Learning for Slow Manifolds and Bifurcation Diagrams
by: Crabtree, Ellis R., et al.
Published: (2025)

Saddle-node bifurcations for concave in measure and d-concave in measure skewproduct flows with applications to population dynamics and circuits
by: Dueñas, Jesús, et al.
Published: (2024)

Performative Control for Linear Dynamical Systems
by: Cai, Songfu, et al.
Published: (2024)

A Dynamical Microscope for Multivariate Oscillatory Signals: Validating Regime Recovery on Shared Manifolds
by: Furman, Łukasz, et al.
Published: (2026)

Time-Delayed Transformers for Data-Driven Modeling of Low-Dimensional Dynamics
by: Alcalde, Albert, et al.
Published: (2026)

Memorisation and forgetting in a learning Hopfield neural network: bifurcation mechanisms, attractors and basins
by: Essex, Adam E., et al.
Published: (2025)

Concave-convex nonautonomous scalar ordinary differential equations: from bifurcation theory to critical transitions
by: Dueñas, Jesús, et al.
Published: (2024)

Critical Transitions for Asymptotically Concave or D-Concave Nonautonomous Differential Equations with Applications in Ecology
by: Dueñas, Jesús, et al.
Published: (2023)

Global bifurcation diagrams for coercive third-degree polynomial ordinary differential equations with recurrent nonautonomous coefficients
by: Elia, Cinzia, et al.
Published: (2025)

Normalization in Attention Dynamics
by: Karagodin, Nikita, et al.
Published: (2025)

Ergodic Generative Flows
by: Brunswic, Leo Maxime, et al.
Published: (2025)

No weakly factor-universal cellular automaton
by: Gwozdz, Maja
Published: (2026)

Universal Approximation Theorems for Dynamical Systems with Infinite-Time Horizon Guarantees
by: Sagodi, Abel, et al.
Published: (2026)

Distributed State Estimation for Linear Time-invariant Systems with Aperiodic Sampled Measurement
by: Wang, Shimin, et al.
Published: (2022)

Losing momentum in continuous-time stochastic optimisation
by: Jin, Kexin, et al.
Published: (2022)

Echoes of the Past: A Unified Perspective on Fading memory and Echo States
by: Ortega, Juan-Pablo, et al.
Published: (2025)