Cover Image

High-Dimensional Analysis of Gradient Flow for Extensive-Width Quadratic Neural Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Martin, Simon, Biroli, Giulio, Bach, Francis
Format:	Preprint
Published:	2026
Subjects:	Optimization and Control Disordered Systems and Neural Networks Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Topological Exploration of High-Dimensional Empirical Risk Landscapes: general approach, and applications to phase retrieval
by: Maillard, Antoine, et al.
Published: (2026)

The Role of the Time-Dependent Hessian in High-Dimensional Optimization
by: Bonnaire, Tony, et al.
Published: (2024)

Asymptotic Dynamics of Alternating Minimization for Bilinear Regression
by: Okajima, Koki, et al.
Published: (2024)

Theory of Speciation Transitions in Diffusion Models with General Class Structure
by: Achilli, Beatrice, et al.
Published: (2026)

Why Diffusion Models Don't Memorize: The Role of Implicit Dynamical Regularization in Training
by: Bonnaire, Tony, et al.
Published: (2025)

Kernel Density Estimators in Large Dimensions
by: Biroli, Giulio, et al.
Published: (2024)

High-Dimensional Limit of Stochastic Gradient Flow via Dynamical Mean-Field Theory
by: Nishiyama, Sota, et al.
Published: (2026)

Non-normal spectral signatures of instability in neural network training dynamics
by: Ghosh, Souvik
Published: (2026)

A Differentiable Measure of Algebraic Complexity: Provably Exact Discovery of Group Structures
by: Huh, Dongsung, et al.
Published: (2025)

CLuP practically achieves $\sim 1.77$ positive and $\sim 0.33$ negative Hopfield model ground state free energy
by: Stojnic, Mihailo
Published: (2025)

A CLuP algorithm to practically achieve $\sim 0.76$ SK--model ground state free energy
by: Stojnic, Mihailo
Published: (2025)

Statistical Physics of Deep Neural Networks: Generalization Capability, Beyond the Infinite Width, and Feature Learning
by: Ariosto, Sebastiano
Published: (2025)

Transfer Learning in Infinite Width Feature Learning Networks
by: Lauditi, Clarissa, et al.
Published: (2025)

Cascade of phase transitions in the training of Energy-based models
by: Bachtis, Dimitrios, et al.
Published: (2024)

Growing Neural Networks: Dynamic Evolution through Gradient Descent
by: Radhakrishnan, Anil, et al.
Published: (2025)

Deep Linear Network Training Dynamics from Random Initialization: Data, Width, Depth, and Hyperparameter Transfer
by: Bordelon, Blake, et al.
Published: (2025)

Optimization Algorithms for Multi-Species Spherical Spin Glasses
by: Huang, Brice, et al.
Published: (2023)

Optimizing Mean Field Spin Glasses with External Field
by: Sellke, Mark
Published: (2021)

Graph Neural Network Approach to Predicting Magnetization in Quasi-One-Dimensional Ising Systems
by: Slavin, V., et al.
Published: (2025)

Iterative quantum optimisation with a warm-started quantum state
by: Yuan, Haomu, et al.
Published: (2025)

Theory of Scaling Laws for In-Context Regression: Depth, Width, Context and Time
by: Bordelon, Blake, et al.
Published: (2025)

Hardness of the Maximum Independent Set Problem on Unit-Disk Graphs and Prospects for Quantum Speedups
by: Andrist, Ruben S., et al.
Published: (2023)

Stochastic Gradient Flow Dynamics of Test Risk and its Exact Solution for Weak Features
by: Veiga, Rodrigo, et al.
Published: (2024)

Emergence of Distortions in High-Dimensional Guided Diffusion Models
by: Ventura, Enrico, et al.
Published: (2026)

A Short Review on Novel Approaches for Maximum Clique Problem: from Classical algorithms to Graph Neural Networks and Quantum algorithms
by: Marino, Raffaele, et al.
Published: (2024)

Optimal Spectral Transitions in High-Dimensional Multi-Index Models
by: Defilippis, Leonardo, et al.
Published: (2025)

Competition, stability, and functionality in excitatory-inhibitory neural circuits
by: Betteti, Simone, et al.
Published: (2025)

Direct comparison of stochastic driven nonlinear dynamical systems for combinatorial optimization
by: Hou, Junpeng, et al.
Published: (2025)

Global Optimization Through Heterogeneous Oscillator Ising Machines
by: Allibhoy, Ahmed, et al.
Published: (2025)

Training Dynamics of Nonlinear Contrastive Learning Model in the High Dimensional Limit
by: Meng, Lineghuan, et al.
Published: (2024)

Formation of Representations in Neural Networks
by: Ziyin, Liu, et al.
Published: (2024)

A High Dimensional Statistical Model for Adversarial Training: Geometry and Trade-Offs
by: Tanner, Kasimir, et al.
Published: (2024)

The Training Process of Many Deep Networks Explores the Same Low-Dimensional Manifold
by: Mao, Jialin, et al.
Published: (2023)

Graph Neural Networks Do Not Always Oversmooth
by: Epping, Bastian, et al.
Published: (2024)

The Rules-and-Facts Model for Simultaneous Generalization and Memorization in Neural Networks
by: Farné, Gabriele, et al.
Published: (2026)

Demolition and Reinforcement of Memories in Spin-Glass-like Neural Networks
by: Ventura, Enrico
Published: (2024)

Dynamical Mean-Field Theory of Self-Attention Neural Networks
by: Poc-López, Ángel, et al.
Published: (2024)

Benchmarking Graph Neural Networks in Solving Hard Constraint Satisfaction Problems
by: Skenderi, Geri, et al.
Published: (2026)

A Random-Matrix Criterion for Initializing Gated Recurrent Neural Networks
by: Fioratti, Tommaso, et al.
Published: (2026)

Controlled Langevin Dynamics for Sampling of Feedforward Neural Networks Trained with Minibatches
by: Zambon, Alessandro, et al.
Published: (2026)