Cover Image

Nonlinear Dynamics In Optimization Landscape of Shallow Neural Networks with Tunable Leaky ReLU

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Liu, Jingzhou
Format:	Preprint
Published:	2025
Subjects:	Optimization and Control Machine Learning Dynamical Systems
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Approximation with Random Shallow ReLU Networks with Applications to Model Reference Adaptive Control
by: Lamperski, Andrew, et al.
Published: (2024)

Function Gradient Approximation with Random Shallow ReLU Networks with Control Applications
by: Lamperski, Andrew, et al.
Published: (2024)

Stability and Performance Analysis of Discrete-Time ReLU Recurrent Neural Networks
by: Noori, Sahel Vahedi, et al.
Published: (2024)

ReLU Networks for Model Predictive Control: Network Complexity and Performance Guarantees
by: Li, Xingchen, et al.
Published: (2026)

Neural Collapse under Gradient Flow on Shallow ReLU Networks for Orthogonally Separable Data
by: Min, Hancheng, et al.
Published: (2025)

A Complete Set of Quadratic Constraints for Repeated ReLU and Generalizations
by: Noori, Sahel Vahedi, et al.
Published: (2024)

Neural Operators for Predictor Feedback Control of Nonlinear Delay Systems
by: Bhan, Luke, et al.
Published: (2024)

Optimal Initialization in Depth: Lyapunov Initialization and Limit Theorems for Deep Leaky ReLU Networks
by: Kogler, Constantin, et al.
Published: (2026)

Convex Formulations for Training Two-Layer ReLU Neural Networks
by: Prakhya, Karthik, et al.
Published: (2024)

Computational Tradeoffs of Optimization-Based Bound Tightening in ReLU Networks
by: Badilla, Fabian, et al.
Published: (2023)

Learning Dissipative Neural Dynamical Systems
by: Xu, Yuezhu, et al.
Published: (2023)

Hidden Minima in Two-Layer ReLU Networks
by: Arjevani, Yossi
Published: (2023)

Provable Accelerated Convergence of Nesterov's Momentum for Deep ReLU Neural Networks
by: Liao, Fangshuo, et al.
Published: (2023)

Safe and Robust Domains of Attraction for Discrete-Time Systems: A Set-Based Characterization and Certifiable Neural Network Estimation
by: Serry, Mohamed, et al.
Published: (2026)

Convex Relaxations of ReLU Neural Networks Approximate Global Optima in Polynomial Time
by: Kim, Sungyoon, et al.
Published: (2024)

Reservoir Predictive Path Integral Control for Unknown Nonlinear Dynamics
by: Inoue, Daisuke, et al.
Published: (2025)

Homotopy Relaxation Training Algorithms for Infinite-Width Two-Layer ReLU Neural Networks
by: Yang, Yahong, et al.
Published: (2023)

Adversarial Training of Two-Layer Polynomial and ReLU Activation Networks via Convex Optimization
by: Kuelbs, Daniel, et al.
Published: (2024)

Gain Scheduling with a Neural Operator for a Transport PDE with Nonlinear Recirculation
by: Lamarque, Maxence, et al.
Published: (2024)

Online Optimization and Ambiguity-based Learning of Distributionally Uncertain Dynamic Systems
by: Li, Dan, et al.
Published: (2021)

Data-driven Nonlinear Model Reduction using Koopman Theory: Integrated Control Form and NMPC Case Study
by: Schulze, Jan C., et al.
Published: (2024)

On the Convergence of Overlapping Schwarz Decomposition for Nonlinear Optimal Control
by: Na, Sen, et al.
Published: (2020)

Stability-Certified Learning of Control Systems with Quadratic Nonlinearities
by: Duff, Igor Pontes, et al.
Published: (2024)

Nonlinear Model Order Reduction of Dynamical Systems in Process Engineering: Review and Comparison
by: Schulze, Jan C., et al.
Published: (2025)

Gradient descent provably escapes saddle points in the training of shallow ReLU networks
by: Cheridito, Patrick, et al.
Published: (2022)

Safely Learning Dynamical Systems
by: Ahmadi, Amir Ali, et al.
Published: (2023)

Dynamical Measure Transport and Neural PDE Solvers for Sampling
by: Sun, Jingtong, et al.
Published: (2024)

Why Smooth Stability Assumptions Fail for ReLU Learning
by: Katende, Ronald
Published: (2025)

An analysis of optimization problems involving ReLU neural networks
by: Plate, Christoph, et al.
Published: (2025)

Control of Medical Digital Twins with Artificial Neural Networks
by: Böttcher, Lucas, et al.
Published: (2024)

Near-Optimal Distributed Linear-Quadratic Regulator for Networked Systems
by: Shin, Sungho, et al.
Published: (2022)

ReLU Surrogates in Mixed-Integer MPC for Irrigation Scheduling
by: Agyeman, Bernard T., et al.
Published: (2024)

Zeroth-Order Optimization at the Edge of Stability
by: Song, Minhak, et al.
Published: (2026)

How Does the ReLU Activation Affect the Implicit Bias of Gradient Descent on High-dimensional Neural Network Regression?
by: Lai, Kuo-Wei, et al.
Published: (2026)

Designing Robust Software Sensors for Nonlinear Systems via Neural Networks and Adaptive Sliding Mode Control
by: Farkane, Ayoub, et al.
Published: (2025)

An Efficient Alternating Algorithm for ReLU-based Symmetric Matrix Decomposition
by: Wang, Qingsong
Published: (2025)

Near-optimal Closed-loop Method via Lyapunov Damping for Convex Optimization
by: Maier, Severin, et al.
Published: (2023)

Learning Spatio-Temporal Dynamics via Operator-Valued RKHS and Kernel Koopman Methods
by: Withanachchi, Mahishanka
Published: (2025)

Safe and Near-Optimal Control with Online Dynamics Learning
by: Prajapat, Manish, et al.
Published: (2025)

MIQCQP reformulation of the ReLU neural networks Lipschitz constant estimation problem
by: Sbihi, Mohammed, et al.
Published: (2024)