Imagen de Portada

Normalization in Attention Dynamics

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Karagodin, Nikita, Ge, Shu, Polyanskiy, Yury, Rigollet, Philippe
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Artificial Intelligence 68T07, 35Q68, 37C10, 37N99, 82C22
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Clustering in Causal Attention Masking
por: Karagodin, Nikita, et al.
Publicado: (2024)

Phase Diagram of Dropout for Two-Layer Neural Networks in the Mean-Field Regime
por: Chizat, Lénaïc, et al.
Publicado: (2025)

The Compute ICE-AGE: Invariant Compute Envelope under Addressable Graph Evolution
por: Martin II, R. Jay
Publicado: (2026)

SympFormer: Accelerated attention blocks via Inertial Dynamics on Density Manifolds
por: Stein, Viktor, et al.
Publicado: (2026)

Convergence, design and training of continuous-time dropout as a random batch method
por: Álvarez-López, Antonio, et al.
Publicado: (2025)

Next Generation Equation-Free Multiscale Modelling of Crowd Dynamics via Machine Learning
por: Alvarez, Hector Vargas, et al.
Publicado: (2025)

Sampling Boltzmann distributions via normalizing flow approximation of transport maps
por: Rehman, Zia Ur, et al.
Publicado: (2026)

Optimization Dynamics of Equivariant and Augmented Neural Networks
por: Nordenfors, Oskar, et al.
Publicado: (2023)

Computational Complexity of Minimal Trap Spaces in Boolean Networks
por: Moon, Kyungduk, et al.
Publicado: (2022)

Surjective Independence of Causal Influences for Local Bayesian Network Structures
por: Drury, Kieran, et al.
Publicado: (2025)

Error estimates of asymptotic-preserving neural networks in approximating stochastic linearized Boltzmann equation
por: Wan, Jiayu, et al.
Publicado: (2025)

Data Augmentation and Regularization for Learning Group Equivariance
por: Nordenfors, Oskar, et al.
Publicado: (2025)

A DeepParticle method for learning and generating aggregation patterns in multi-dimensional Keller-Segel chemotaxis systems
por: Wang, Zhongjian, et al.
Publicado: (2022)

ARDO: A Weak Formulation Deep Neural Network Method for Elliptic and Parabolic PDEs Based on Random Differences of Test Functions
por: Cai, Wei, et al.
Publicado: (2025)

Tracking Finite-Time Lyapunov Exponents to Robustify Neural ODEs
por: Wöhrer, Tobias, et al.
Publicado: (2026)

Structural Refinement of Bayesian Networks for Efficient Model Parameterisation
por: Drury, Kieran, et al.
Publicado: (2025)

Ergodic Generative Flows
por: Brunswic, Leo Maxime, et al.
Publicado: (2025)

Introducing COGENT3: An AI Architecture for Emergent Cognition
por: Salazar, Eduardo
Publicado: (2025)

Cluster-based classification with neural ODEs via control
por: Álvarez-López, Antonio, et al.
Publicado: (2023)

Data-driven Identification of Attractors Using Machine Learning
por: Gameiro, Marcio, et al.
Publicado: (2025)

Dynamic Level Sets
por: Fiske, Michael Stephen
Publicado: (2026)

A Physics-Informed, Global-in-Time Neural Particle Method for the Spatially Homogeneous Landau Equation
por: Kim, Minseok, et al.
Publicado: (2026)

Latent Space Dynamics Identification for Interface Tracking with Application to Shock-Induced Pore Collapse
por: Chung, Seung Whan, et al.
Publicado: (2025)

Universal Approximation Theorems for Dynamical Systems with Infinite-Time Horizon Guarantees
por: Sagodi, Abel, et al.
Publicado: (2026)

A Formal Analysis of Iterated TDD
por: Ruparel, Hemil, et al.
Publicado: (2024)

Optimal Transport for $ε$-Contaminated Credal Sets: To the Memory of Sayan Mukherjee
por: Caprio, Michele
Publicado: (2024)

Machine Learning-based quadratic closures for non-intrusive Reduced Order Models
por: Codega, Gabriele, et al.
Publicado: (2025)

Agent-Centric Personalized Multiple Clustering with Multi-Modal LLMs
por: Chen, Ziye, et al.
Publicado: (2025)

The Predictive-Causal Gap: An Impossibility Theorem and Large-Scale Neural Evidence
por: Liu, Kejun
Publicado: (2026)

A Dynamical Microscope for Multivariate Oscillatory Signals: Validating Regime Recovery on Shared Manifolds
por: Furman, Łukasz, et al.
Publicado: (2026)

Localmax dynamics for attention in transformers and its asymptotic behavior
por: Cimetière, Henri, et al.
Publicado: (2025)

Invariant Manifolds of Discrete-time Dynamical Systems with Nonlinear Exosystems via Hybrid Physics-Informed Neural Networks
por: Patsatzis, Dimitrios G., et al.
Publicado: (2025)

Neural Network-Enhanced Disease Spread Dynamics Over Time and Space
por: Caga-anan, Randy L.
Publicado: (2024)

Losing momentum in continuous-time stochastic optimisation
por: Jin, Kexin, et al.
Publicado: (2022)

Gradient Flow Structure and Quantitative Dynamics of Multi-Head Self-Attention
por: Pendharkar, Ayan
Publicado: (2026)

Neural Manifolds as Crystallized Embeddings: A Synthesis of the Free Energy Principle, Generalized Synchronization, and Hebbian Plasticity
por: O'Reilly-Shah, Vikas N.
Publicado: (2026)

Transformer-based Koopman Autoencoder for Linearizing Fisher's Equation
por: Rana, Kanav Singh, et al.
Publicado: (2024)

Functional Graphs for Predicting and Explaining Goal Failure in Sparse Goal-Conditioned RL
por: Dash, Shalley
Publicado: (2026)

Mathematical and numerical methods for understanding immune cell motion during wound healing
por: Lupi, Giulia, et al.
Publicado: (2025)

Stochastic Latent Transformer: Efficient Modelling of Stochastically Forced Zonal Jets
por: Shokar, Ira J. S., et al.
Publicado: (2023)