Cover Image

Scaling ResNets in the Large-depth Regime

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Marion, Pierre, Fermanian, Adeline, Biau, Gérard, Vert, Jean-Philippe
Format:	Preprint
Published:	2022
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Generalization of Scaled Deep ResNets in the Mean-Field Regime
by: Chen, Yihang, et al.
Published: (2024)

On the inductive bias of infinite-depth ResNets and the bottleneck rank
by: Boix-Adsera, Enric
Published: (2025)

Taking a Big Step: Large Learning Rates in Denoising Score Matching Prevent Memorization
by: Wu, Yu-Han, et al.
Published: (2025)

ResNets of All Shapes and Sizes: Convergence of Training Dynamics in the Large-scale Limit
by: Chaintron, Louis-Pierre, et al.
Published: (2026)

Bridging Neural ODE and ResNet: A Formal Error Bound for Safety Verification
by: Sayed, Abdelrahman Sayed, et al.
Published: (2025)

Attention layers provably solve single-location regression
by: Marion, Pierre, et al.
Published: (2024)

ResNets Are Deeper Than You Think
by: Mehmeti-Göpel, Christian H. X. Ali, et al.
Published: (2025)

L-Lipschitz Gershgorin ResNet Network
by: Juston, Marius F. R., et al.
Published: (2025)

Transformative or Conservative? Conservation laws for ResNets and Transformers
by: Marcotte, Sibylle, et al.
Published: (2025)

Naturally Computed Scale Invariance in the Residual Stream of ResNet18
by: Longon, André
Published: (2025)

Interpreting the Residual Stream of ResNet18
by: Longon, André
Published: (2024)

Approximation theory for 1-Lipschitz ResNets
by: Murari, Davide, et al.
Published: (2025)

Implicit regularization of deep residual networks towards neural ODEs
by: Marion, Pierre, et al.
Published: (2023)

Branch Scaling Manifests as Implicit Architectural Regularization for Improving Generalization in Overparameterized ResNets
by: Yu, Zixiong, et al.
Published: (2024)

On Dissipativity of Cross-Entropy Loss in Training ResNets
by: Püttschneider, Jens, et al.
Published: (2024)

Field theory for optimal signal propagation in ResNets
by: Fischer, Kirsten, et al.
Published: (2023)

Collective Kernel EFT for Pre-activation ResNets
by: Kawase, Hidetoshi, et al.
Published: (2026)

Towards an Optimal Control Perspective of ResNet Training
by: Püttschneider, Jens, et al.
Published: (2025)

Arithmetic-Mean $μ$P for Modern Architectures: A Unified Learning-Rate Scale for CNNs and ResNets
by: Zhang, Haosong, et al.
Published: (2025)

Hamiltonian Mechanics of Feature Learning: Bottleneck Structure in Leaky ResNets
by: Jacot, Arthur, et al.
Published: (2024)

Overparameterization of deep ResNet: zero loss and mean-field analysis
by: Ding, Zhiyan, et al.
Published: (2021)

Neural Collapse is Globally Optimal in Deep Regularized ResNets and Transformers
by: Súkeník, Peter, et al.
Published: (2025)

Poly-MgNet: Polynomial Building Blocks in Multigrid-Inspired ResNets
by: van Betteray, Antonia, et al.
Published: (2025)

Progressive Feedforward Collapse of ResNet Training
by: Wang, Sicong, et al.
Published: (2024)

Latent Guided Sampling for Combinatorial Optimization
by: Surendran, Sobihan, et al.
Published: (2025)

Understanding the training of infinitely deep and wide ResNets with Conditional Optimal Transport
by: Barboni, Raphaël, et al.
Published: (2024)

Optimal Stopping in Latent Diffusion Models
by: Wu, Yu-Han, et al.
Published: (2025)

Approximating Langevin Monte Carlo with ResNet-like Neural Network architectures
by: Miranda, Charles, et al.
Published: (2023)

DenseNets Reloaded: Paradigm Shift Beyond ResNets and ViTs
by: Kim, Donghyun, et al.
Published: (2024)

On Mixup Regularization
by: Carratino, Luigi, et al.
Published: (2020)

Invertible ResNets for Inverse Imaging Problems: Competitive Performance with Provable Regularization Properties
by: Arndt, Clemens, et al.
Published: (2024)

Deep Learning as a Convex Paradigm of Computation: Minimizing Circuit Size with ResNets
by: Jacot, Arthur
Published: (2025)

Cardioformer: Advancing AI in ECG Analysis with Multi-Granularity Patching and ResNet
by: Mobin, Md Kamrujjaman, et al.
Published: (2025)

Dynamical Survival Analysis with Controlled Latent States
by: Bleistein, Linus, et al.
Published: (2024)

Multivariate Online Linear Regression for Hierarchical Forecasting
by: Hihat, Massil, et al.
Published: (2024)

Acute Lymphoblastic Leukemia Diagnosis Employing YOLOv11, YOLOv8, ResNet50, and Inception-ResNet-v2 Deep Learning Models
by: Awad, Alaa, et al.
Published: (2025)

Universal Approximation Constraints of Narrow ResNets: The Tunnel Effect
by: Kuehn, Christian, et al.
Published: (2026)

Towards Graph-Based Privacy-Preserving Federated Learning: ModelNet -- A ResNet-based Model Classification Dataset
by: Ray, Abhisek, et al.
Published: (2025)

Transductive Conformal Inference for Full Ranking
by: Fermanian, Jean-Baptiste, et al.
Published: (2025)

Exploring Secure Machine Learning Through Payload Injection and FGSM Attacks on ResNet-50
by: Yadav, Umesh, et al.
Published: (2025)