Image de couverture de livre

Asymptotic Smoothing of the Lipschitz Loss Landscape in Overparameterized One-Hidden-Layer ReLU Networks

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteur principal:	Baturin, Saveliy
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Mildly Overparameterized ReLU Networks Have a Favorable Loss Landscape
par: Karhadkar, Kedar, et autres
Publié: (2023)

Hidden Minima in Two-Layer ReLU Networks
par: Arjevani, Yossi
Publié: (2023)

On the Principles of ReLU Networks with One Hidden Layer
par: Huang, Changcun
Publié: (2024)

Mildly Overparameterized ReLU Networks on Orthogonal Data: Incremental Learning and Implicit Bias
par: Town, James, et autres
Publié: (2026)

Convex Approximation of Two-Layer ReLU Networks for Hidden State Differential Privacy
par: Romijnders, Rob, et autres
Publié: (2024)

Discrete Functional Geometry of ReLU Networks via ReLU Transition Graphs
par: Dhayalkar, Sahil Rajesh
Publié: (2025)

The Symmetries of Three-Layer ReLU Networks
par: Gegenfurtner, Johanna Marie, et autres
Publié: (2026)

Loss Landscape of Shallow ReLU-like Neural Networks: Stationary Points, Saddle Escape, and Network Embedding
par: Wu, Frank Zhengqing, et autres
Publié: (2024)

Training a Two Layer ReLU Network Analytically
par: Barbu, Adrian
Publié: (2023)

Complexity of One-Dimensional ReLU DNNs
par: Kogan, Jonathan, et autres
Publié: (2025)

The Geometry of ReLU Networks through the ReLU Transition Graph
par: Dhayalkar, Sahil Rajesh
Publié: (2025)

Does Flatness imply Generalization for Logistic Loss in Univariate Two-Layer ReLU Network?
par: Qiao, Dan, et autres
Publié: (2025)

N-ReLU: Zero-Mean Stochastic Extension of ReLU
par: Manik, Md Motaleb Hossen, et autres
Publié: (2025)

ConquerNet: Convolution-Smoothed Quantile ReLU Neural Networks with Minimax Guarantees
par: Luo, Tianpai, et autres
Publié: (2026)

Why Smooth Stability Assumptions Fail for ReLU Learning
par: Katende, Ronald
Publié: (2025)

The Resurrection of the ReLU
par: Horuz, Coşku Can, et autres
Publié: (2025)

Benign Overfitting for Regression with Trained Two-Layer ReLU Networks
par: Park, Junhyung, et autres
Publié: (2024)

Convex Formulations for Training Two-Layer ReLU Neural Networks
par: Prakhya, Karthik, et autres
Publié: (2024)

A Rescaling-Invariant Lipschitz Bound Based on Path-Metrics for Modern ReLU Network Parameterizations
par: Gonon, Antoine, et autres
Publié: (2024)

MIQCQP reformulation of the ReLU neural networks Lipschitz constant estimation problem
par: Sbihi, Mohammed, et autres
Publié: (2024)

Pathwise Explanation of ReLU Neural Networks
par: Lim, Seongwoo, et autres
Publié: (2025)

Provable Multi-Task Representation Learning by Two-Layer ReLU Neural Networks
par: Collins, Liam, et autres
Publié: (2023)

Online Realizable Regression and Applications for ReLU Networks
par: Doron-Arad, Ilan, et autres
Publié: (2026)

Optimal Sets and Solution Paths of ReLU Networks
par: Mishkin, Aaron, et autres
Publié: (2023)

On Size-Independent Sample Complexity of ReLU Networks
par: Sellke, Mark
Publié: (2023)

Convexity in ReLU Neural Networks: beyond ICNNs?
par: Gagneux, Anne, et autres
Publié: (2025)

SurvReLU: Inherently Interpretable Survival Analysis via Deep ReLU Networks
par: Sun, Xiaotong, et autres
Publié: (2024)

Neural Tangent Kernels and Fisher Information Matrices for Simple ReLU Networks with Random Hidden Weights
par: Takeuchi, Jun'ichi, et autres
Publié: (2025)

Stochastic Bandits with ReLU Neural Networks
par: Xu, Kan, et autres
Publié: (2024)

On Space Folds of ReLU Neural Networks
par: Lewandowski, Michal, et autres
Publié: (2025)

Optimal lower Lipschitz bounds for ReLU layers, saturation, and phase retrieval
par: Freeman, Daniel, et autres
Publié: (2025)

Nonlinear Dynamics In Optimization Landscape of Shallow Neural Networks with Tunable Leaky ReLU
par: Liu, Jingzhou
Publié: (2025)

ReLU-KAN: New Kolmogorov-Arnold Networks that Only Need Matrix Addition, Dot Multiplication, and ReLU
par: Qiu, Qi, et autres
Publié: (2024)

Topological Expressivity of ReLU Neural Networks
par: Ergen, Ekin, et autres
Publié: (2023)

Three Quantization Regimes for ReLU Networks
par: Ou, Weigutian, et autres
Publié: (2024)

ReLU Neural Networks with Linear Layers are Biased Towards Single- and Multi-Index Models
par: Parkinson, Suzanna, et autres
Publié: (2023)

On the Local Complexity of Linear Regions in Deep ReLU Networks
par: Patel, Niket, et autres
Publié: (2024)

ReLU Networks as Random Functions: Their Distribution in Probability Space
par: Chaudhari, Shreyas, et autres
Publié: (2025)

Noisy Interpolation Learning with Shallow Univariate ReLU Networks
par: Joshi, Nirmit, et autres
Publié: (2023)

Implicit Hypersurface Approximation Capacity in Deep ReLU Networks
par: Vallin, Jonatan, et autres
Publié: (2024)