Cover Image

Two-Time-Scale Learning Dynamics: A Population View of Neural Network Training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Borghi, Giacomo, Im, Hyesung, Pareschi, Lorenzo
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Analysis of PDEs 68T05, 65C35, 35Q80, 68Q32
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Analysis of mean-field models arising from self-attention dynamics in transformer architectures with layer normalization
by: Burger, Martin, et al.
Published: (2025)

Swarm-based optimization with jumps: a kinetic BGK framework and convergence analysis
by: Borghi, Giacomo, et al.
Published: (2025)

Wasserstein convergence rates for stochastic particle approximation of Boltzmann models
by: Borghi, Giacomo, et al.
Published: (2025)

A PDE Perspective on Generative Diffusion Models
by: Liu, Kang, et al.
Published: (2025)

Learning on the Temporal Tangent Bundle for Physics-Informed Neural Networks
by: Jamal, Adetola, et al.
Published: (2026)

Consistency of semi-supervised learning, stochastic tug-of-war games, and the p-Laplacian
by: Calder, Jeff, et al.
Published: (2024)

Neural Discovery of Strichartz Extremizers
by: Valenzuela, Nicolás, et al.
Published: (2026)

Stein Variational Gradient Descent dynamics for highly concentrated kernels
by: Carrillo, José A., et al.
Published: (2026)

Perturbation Analysis and Neural Network-Based Initial Condition Estimation for the Sine-Gordon Equation
by: Ha, Junhong, et al.
Published: (2025)

High-Fidelity Modeling of Stochastic Chemical Dynamics on Complex Manifolds: A Multi-Scale SIREN-PINN Framework for the Curvature-Perturbed Ginzburg-Landau Equation
by: Chrisnanto, Julian Evan, et al.
Published: (2026)

Relativistic BGK model for reactive gas mixtures
by: Cho, Seung-Yeon, et al.
Published: (2025)

Sharp Fuss-Catalan thresholds in graph bootstrap percolation
by: Bartha, Zsolt, et al.
Published: (2025)

A Recipe for Learning Variably Scaled Kernels via Discontinuous Neural Networks
by: Audone, Gianluca, et al.
Published: (2024)

Dirac solitons in one-dimensional nonlinear Schrödinger equations
by: Borrelli, William, et al.
Published: (2025)

Machine Learning-based quadratic closures for non-intrusive Reduced Order Models
by: Codega, Gabriele, et al.
Published: (2025)

Quantitative Local Convergence of Mean-Field Stein Variational Gradient Flow
by: Chizat, Lénaïc, et al.
Published: (2026)

Kinetic description and convergence analysis of genetic algorithms for global optimization
by: Borghi, Giacomo, et al.
Published: (2023)

Learning Neural Pushforward Samplers for Distributions from Fokker-Planck Equations by Weak Adversarial Training
by: He, Andrew Qing, et al.
Published: (2025)

A Unified Perspective on the Dynamics of Deep Transformers
by: Castin, Valérie, et al.
Published: (2025)

Numerical simulation of resistance furnaces by using distributed and lumped models
by: Bermúdez, A., et al.
Published: (2024)

Smooth nonradial stationary Euler flows on the plane with compact support
by: Enciso, Alberto, et al.
Published: (2024)

Radon--Wasserstein Gradient Flows for Interacting-Particle Sampling in High Dimensions
by: Hess-Childs, Elias, et al.
Published: (2026)

On the convergence of PINNs for inverse source problem in the complex Ginzburg-Landau equation
by: Cheng, Xing, et al.
Published: (2025)

Core detection via Ricci curvature flows on weighted graphs
by: Zhao, Juan, et al.
Published: (2025)

A non-autonomous p-Adic diffusion equation on time changing graphs
by: Bradley, Patrick Erik, et al.
Published: (2024)

Fast Maxwell Solvers Based on Exact Discrete Eigen-Decompositions I. Two-Dimensional Case
by: Wang, Lixiu, et al.
Published: (2025)

The Stein-log-Sobolev inequality and the exponential rate of convergence for the continuous Stein variational gradient descent method
by: Carrillo, José A., et al.
Published: (2024)

Transport based particle methods for the Fokker-Planck-Landau equation
by: Ilin, Vasily, et al.
Published: (2024)

Quantifying Concentration Phenomena of Mean-Field Transformers in the Low-Temperature Regime
by: Alcalde, Albert, et al.
Published: (2026)

Analysis of a Computational Framework for Bayesian Inverse Problems: Ensemble Kalman Updates and MAP Estimators Under Mesh Refinement
by: Sanz-Alonso, Daniel, et al.
Published: (2023)

An Operator Learning Approach to Nonsmooth Optimal Control of Nonlinear PDEs
by: Song, Yongcun, et al.
Published: (2024)

Is Stochastic Gradient Descent Effective? A PDE Perspective on Machine Learning processes
by: Barbieri, Davide, et al.
Published: (2025)

$H$-percolation with a random $H$
by: Bartha, Zsolt, et al.
Published: (2023)

Training-Induced Escape from Token Clustering in a Mean-Field Formulation of Transformers
by: Isobe, Noboru, et al.
Published: (2026)

Solving the BGK Model and Boltzmann equation by Fourier Neural Operator with conservative constraints
by: Hu, Boyun, et al.
Published: (2025)

pETNNs: Partial Evolutionary Tensor Neural Networks for Solving Time-dependent Partial Differential Equations
by: Kao, Tunan, et al.
Published: (2024)

Optimal Control of the Sabatier Process in Microchannel Reactors
by: Blauth, Sebastian, et al.
Published: (2020)

On the smallness conditions for a PEMFC single cell problem
by: Consiglieri, Luisa
Published: (2023)

The critical activation density in graph bootstrap percolation
by: Kolesnik, Brett, et al.
Published: (2026)

Weak Adversarial Neural Pushforward Method for the McKean-Vlasov / Mean-Field Fokker-Planck Equation
by: He, Andrew Qing, et al.
Published: (2026)