Cover Image

Objective Value Change and Shape-Based Accelerated Optimization for the Neural Network Approximation

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xie, Pengcheng, Zhou, Zihao, Zhou, Zijian
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Numerical Analysis Optimization and Control 68T07, 65K05, 65D15, 90C30
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

An Augmented Lagrangian Method for Training Recurrent Neural Networks
by: Wang, Yue, et al.
Published: (2024)

Global Optimization with A Power-Transformed Objective and Gaussian Smoothing
by: Xu, Chen
Published: (2024)

ASPEN: An Additional Sampling Penalty Method for Finite-Sum Optimization Problems with Nonlinear Equality Constraints
by: Krejić, Nataša, et al.
Published: (2025)

Distributed Gradient-Regularized Newton Method: Scheduled Consensus and O(epsilon^{-1}) Global Iteration Complexity
by: Hu, Wei, et al.
Published: (2026)

Optimization on product manifolds under a preconditioned metric
by: Gao, Bin, et al.
Published: (2023)

Sufficient Conditions for Error Distance Reduction in the (\ell^2)-norm Trust Region between Minimizers of Local Nonconvex Multivariate Quadratic Approximates
by: Xie, Pengcheng
Published: (2023)

Power Homotopy for Zeroth-Order Non-Convex Optimizations
by: Xu, Chen
Published: (2025)

Deep Learning Based on Randomized Quasi-Monte Carlo Method for Solving Linear Kolmogorov Partial Differential Equation
by: Xiao, Jichang, et al.
Published: (2023)

Model-Driven Subspaces for Large-Scale Optimization with Local Approximation Strategy
by: He, Yitong, et al.
Published: (2025)

SVD-Preconditioned Gradient Descent Method for Solving Nonlinear Least Squares Problems
by: Chang, Zhipeng, et al.
Published: (2026)

Low-rank optimization on Tucker tensor varieties
by: Gao, Bin, et al.
Published: (2023)

Optimization in Theory and Practice
by: Wright, Stephen J.
Published: (2025)

Stochastic momentum ADMM for nonconvex and nonsmooth optimization with application to PnP algorithm
by: Deng, Kangkang, et al.
Published: (2025)

Privacy-Preserving Black-Box Optimization (PBBO): Theory and the Model-Based Algorithm DFOp
by: Xie, Pengcheng
Published: (2025)

Preconditioned subgradient method for composite optimization: overparameterization and fast convergence
by: Díaz, Mateo, et al.
Published: (2025)

A practical randomized trust-region method to escape saddle points in high dimension
by: Dragomir, Radu-Alexandru, et al.
Published: (2026)

Stochastic optimization over proximally smooth sets
by: Davis, Damek, et al.
Published: (2020)

A Novel First-order Method with Event-driven Objective Evaluations
by: Varner, Christian, et al.
Published: (2025)

Progressive Power Homotopy for Non-convex Optimization
by: Xu, Chen
Published: (2026)

Convergence Conditions for Stochastic Line Search Based Optimization of Over-parametrized Models
by: Lapucci, Matteo, et al.
Published: (2024)

A Novel Gradient Methodology with Economical Objective Function Evaluations for Data Science Applications
by: Varner, Christian, et al.
Published: (2023)

Effectively Leveraging Momentum Terms in Stochastic Line Search Frameworks for Fast Optimization of Finite-Sum Problems
by: Lapucci, Matteo, et al.
Published: (2024)

A novel numerical method tailored for unconstrained optimization problems
by: Li, Lin, et al.
Published: (2025)

A Layer Separation Optimization Framework for Cross-Entropy Training in Deep Learning
by: Liu, Yaru, et al.
Published: (2026)

Accelerated Gradient Methods with Gradient Restart: Global Linear Convergence
by: Bao, Chenglong, et al.
Published: (2024)

Stochastic Approach for Price Optimization Problems with Decision-dependent Uncertainty
by: Hikima, Yuya, et al.
Published: (2023)

Desingularization of bounded-rank tensor sets
by: Gao, Bin, et al.
Published: (2024)

The Global R-linear Convergence of Nesterov's Accelerated Gradient Method with Unknown Strongly Convex Parameter
by: Bao, Chenglong, et al.
Published: (2023)

Inexact Riemannian Gradient Descent Method for Nonconvex Optimization
by: Zhou, Juan, et al.
Published: (2024)

Adaptive Multilevel Newton: A Quadratically Convergent Optimization Method
by: Tsipinakis, Nick, et al.
Published: (2025)

Design Guidelines for Noise-Tolerant Optimization with Applications in Robust Design
by: Lou, Yuchen, et al.
Published: (2024)

The Challenges of Optimization For Data Science
by: Varner, Christian, et al.
Published: (2024)

A Sequential Quadratic Programming Method for Optimization with Stochastic Objective Functions, Deterministic Inequality Constraints and Robust Subproblems
by: Qiu, Songqiang, et al.
Published: (2023)

AS-BOX: Additional Sampling Method for Weighted Sum Problems with Box Constraints
by: Krejić, Nataša, et al.
Published: (2025)

Deep Learning without Global Optimization by Random Fourier Neural Networks
by: Davis, Owen, et al.
Published: (2024)

An Additively Preconditioned Trust Region Strategy for Machine Learning
by: Alegría, Samuel Cruz, et al.
Published: (2025)

A Sequential Homotopy Method for Mathematical Programming Problems
by: Potschka, Andreas, et al.
Published: (2019)

A neuron-wise subspace correction method for the finite neuron method
by: Park, Jongho, et al.
Published: (2022)

MATRO: Metric-Aware Trust-Region Optimization with Fully Quadratic Models
by: Hu, Wei, et al.
Published: (2026)

BUP-TR: Bayesian Underdetermined Projection Trust-Region Methods for Derivative-Free Optimization
by: Hu, Wei, et al.
Published: (2026)