Cover Image

Recent Advances in Non-convex Smoothness Conditions and Applicability to Deep Linear Neural Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Patel, Vivak, Varner, Christian
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Optimization and Control 65K10, 68T07
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Error Bound Analysis for the Regularized Loss of Deep Linear Neural Networks
by: Chen, Po, et al.
Published: (2025)

The Challenges of Optimization For Data Science
by: Varner, Christian, et al.
Published: (2024)

A Novel Gradient Methodology with Economical Objective Function Evaluations for Data Science Applications
by: Varner, Christian, et al.
Published: (2023)

A Novel First-order Method with Event-driven Objective Evaluations
by: Varner, Christian, et al.
Published: (2025)

Fixed-Point Neural Optimal Transport without Implicit Differentiation
by: Park, Yesom, et al.
Published: (2026)

A Layer Separation Optimization Framework for Cross-Entropy Training in Deep Learning
by: Liu, Yaru, et al.
Published: (2026)

Expansive Natural Neural Gradient Flows for Energy Minimization
by: Dahmen, Wolfgang, et al.
Published: (2025)

The Pontryagin Maximum Principle for Training Convolutional Neural Networks
by: Hofmann, Sebastian, et al.
Published: (2025)

Progressive Power Homotopy for Non-convex Optimization
by: Xu, Chen
Published: (2026)

A network based approach for unbalanced optimal transport on surfaces
by: Pan, Jiangong, et al.
Published: (2024)

Global Optimization with A Power-Transformed Objective and Gaussian Smoothing
by: Xu, Chen
Published: (2024)

Variational conditional normalizing flows for computing second-order mean field control problems
by: Zhao, Jiaxi, et al.
Published: (2025)

SVD-Preconditioned Gradient Descent Method for Solving Nonlinear Least Squares Problems
by: Chang, Zhipeng, et al.
Published: (2026)

Faster Adaptive Optimization via Expected Gradient Outer Product Reparameterization
by: DePavia, Adela, et al.
Published: (2025)

Power Homotopy for Zeroth-Order Non-Convex Optimizations
by: Xu, Chen
Published: (2025)

Randomized Matrix Sketching for Neural Network Training and Gradient Monitoring
by: Antil, Harbir, et al.
Published: (2025)

Approximation of the Proximal Operator of the $\ell_\infty$ Norm Using a Neural Network
by: Linehan, Kathryn, et al.
Published: (2024)

Self2Seg: Single-Image Self-Supervised Joint Segmentation and Denoising
by: Gruber, Nadja, et al.
Published: (2023)

Convergence, design and training of continuous-time dropout as a random batch method
by: Álvarez-López, Antonio, et al.
Published: (2025)

Convergence of gradient descent for deep neural networks
by: Chatterjee, Sourav
Published: (2022)

Approximation and Gradient Descent Training with Neural Networks
by: Welper, G.
Published: (2024)

A Single-Loop Bilevel Deep Learning Method for Optimal Control of Obstacle Problems
by: Song, Yongcun, et al.
Published: (2026)

Stochastic Mirror Descent for Convex Optimization with Consensus Constraints
by: Borovykh, Anastasia, et al.
Published: (2022)

Deep Unfolding Network for Nonlinear Multi-Frequency Electrical Impedance Tomography
by: Alberti, Giovanni S., et al.
Published: (2025)

Deep Predictor-Corrector Networks for Robust Parameter Estimation in Non-autonomous System with Discontinuous Inputs
by: Gu, Gyeongwan, et al.
Published: (2026)

Prox-PINNs: A Deep Learning Algorithmic Framework for Elliptic Variational Inequalities
by: Gao, Yu, et al.
Published: (2025)

Meshless Shape Optimization using Neural Networks and Partial Differential Equations on Graphs
by: Martinet, Eloi, et al.
Published: (2025)

Convergence of Momentum-Based Optimization Algorithms with Time-Varying Parameters
by: Vidyasagar, Mathukumalli
Published: (2025)

Asymptotic stability properties and a priori bounds for Adam and other gradient descent optimization methods
by: Dereich, Steffen, et al.
Published: (2025)

Non-Asymptotic Analysis of Projected Gradient Descent for Physics-Informed Neural Networks
by: Nießen, Jonas, et al.
Published: (2025)

Objective Value Change and Shape-Based Accelerated Optimization for the Neural Network Approximation
by: Xie, Pengcheng, et al.
Published: (2025)

Neural-network methods for two-dimensional finite-source reflector design
by: Hacking, Roel, et al.
Published: (2026)

Adam Improves Muon: Adaptive Moment Estimation with Orthogonalized Momentum
by: Zhang, Minxin, et al.
Published: (2026)

To be or not to be stable, that is the question: understanding neural networks for inverse problems
by: Evangelista, Davide, et al.
Published: (2022)

Learning where to learn: Training data distribution optimization for scientific machine learning
by: Guerra, Nicolas, et al.
Published: (2025)

Consensus-based optimization for closed-box adversarial attacks and a connection to evolution strategies
by: Roith, Tim, et al.
Published: (2025)

An Adaptive Tensor-Train Decomposition Approach for Efficient Deep Neural Network Compression
by: Luo, Shiyi, et al.
Published: (2024)

An Augmented Lagrangian Method for Training Recurrent Neural Networks
by: Wang, Yue, et al.
Published: (2024)

Riemannian AmbientFlow: Towards Simultaneous Manifold Learning and Generative Modeling from Corrupted Data
by: Diepeveen, Willem, et al.
Published: (2026)

Convergence Conditions for Stochastic Line Search Based Optimization of Over-parametrized Models
by: Lapucci, Matteo, et al.
Published: (2024)