Cover Image

Intrinsic training dynamics of deep neural networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Marcotte, Sibylle, Peyré, Gabriel, Gribonval, Rémi
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Transformative or Conservative? Conservation laws for ResNets and Transformers
by: Marcotte, Sibylle, et al.
Published: (2025)

Abide by the Law and Follow the Flow: Conservation Laws for Gradient Flows
by: Marcotte, Sibylle, et al.
Published: (2023)

Keep the Momentum: Conservation Laws beyond Euclidean Gradient Flows
by: Marcotte, Sibylle, et al.
Published: (2024)

Path-conditioned training: a principled way to rescale ReLU neural networks
by: Lebeurrier, Arthur, et al.
Published: (2026)

Ultra-fast feature learning for the training of two-layer neural networks in the two-timescale regime
by: Barboni, Raphaël, et al.
Published: (2025)

Revisiting RIP guarantees for sketching operators on mixture models
by: Belhadji, Ayoub, et al.
Published: (2023)

Sketch and shift: a robust decoder for compressive clustering
by: Belhadji, Ayoub, et al.
Published: (2023)

Understanding the training of infinitely deep and wide ResNets with Conditional Optimal Transport
by: Barboni, Raphaël, et al.
Published: (2024)

A path-norm toolkit for modern networks: consequences, promises and challenges
by: Gonon, Antoine, et al.
Published: (2023)

On the Statistical Complexity of Estimation and Testing under Privacy Constraints
by: Lalanne, Clément, et al.
Published: (2022)

Robust Sublinear Convergence Rates for Iterative Bregman Projections
by: Peyré, Gabriel
Published: (2026)

Convexity in ReLU Neural Networks: beyond ICNNs?
by: Gagneux, Anne, et al.
Published: (2025)

Non-Vacuous Generalization Bounds: Can Rescaling Invariances Help?
by: Rouchouse, Damien, et al.
Published: (2025)

A Rescaling-Invariant Lipschitz Bound Based on Path-Metrics for Modern ReLU Network Parameterizations
by: Gonon, Antoine, et al.
Published: (2024)

Effective regions and kernels in continuous sparse regularisation, with application to sketched mixtures
by: De Castro, Yohann, et al.
Published: (2025)

Optimal and Diffusion Transports in Machine Learning
by: Peyré, Gabriel
Published: (2025)

Optimal Transport for Machine Learners
by: Peyré, Gabriel
Published: (2025)

Muon Dynamics as a Spectral Wasserstein Flow
by: Peyré, Gabriel
Published: (2026)

Can overfitted deep neural networks in adversarial training generalize? -- An approximation viewpoint
by: Shi, Zhongjie, et al.
Published: (2024)

Comparison of neural network training strategies for the simulation of dynamical systems
by: Strasser, Paul, et al.
Published: (2025)

Asymmetrical estimator for training encapsulated deep photonic neural networks
by: Wang, Yizhi, et al.
Published: (2024)

How many samples are needed to train a deep neural network?
by: Golestaneh, Pegah, et al.
Published: (2024)

Wasserstein distributional adversarial training for deep neural networks
by: Bai, Xingjian, et al.
Published: (2025)

Towards Understanding the Universality of Transformers for Next-Token Prediction
by: Sander, Michael E., et al.
Published: (2024)

PASCO (PArallel Structured COarsening): an overlay to speed up graph clustering algorithms
by: Lasalle, Etienne, et al.
Published: (2024)

The Generation Phases of Flow Matching: a Denoising Perspective
by: Gagneux, Anne, et al.
Published: (2025)

Power side-channel leakage localization through adversarial training of deep neural networks
by: Gammell, Jimmy, et al.
Published: (2024)

How Smooth Is Attention?
by: Castin, Valérie, et al.
Published: (2023)

Geometry-Aware Discretization Error of Diffusion Models
by: Hurault, Samuel, et al.
Published: (2026)

Towards generalizable deep ptychography neural networks
by: Vong, Albert, et al.
Published: (2025)

An axiomatized PDE model of deep neural networks
by: Wang, Tangjun, et al.
Published: (2023)

Mitigating multiple single-event upsets during deep neural network inference using fault-aware training
by: Vinck, Toon, et al.
Published: (2025)

Efficient and provably convergent end-to-end training of deep neural networks with linear constraints
by: Yang, Zonglin, et al.
Published: (2026)

A simple theory for training response of deep neural networks
by: Nakazato, Kenichi
Published: (2024)

Motif distribution and function of sparse deep neural networks
by: Zahn, Olivia T., et al.
Published: (2024)

Infinite-channel deep stable convolutional neural networks
by: Bracale, Daniele, et al.
Published: (2021)

Learning from Samples: Inverse Problems over measures via Sharpened Fenchel-Young Losses
by: Andrade, Francisco, et al.
Published: (2025)

On the global convergence of gradient descent for wide shallow models with bounded nonlinearities
by: Petit, Romain, et al.
Published: (2026)

On Feynman--Kac training of partial Bayesian neural networks
by: Zhao, Zheng, et al.
Published: (2023)

A lift for input-convex neural network training
by: Siahkoohi, Ali, et al.
Published: (2026)