Cover Image

SVD-Preconditioned Gradient Descent Method for Solving Nonlinear Least Squares Problems

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chang, Zhipeng, Hao, Wenrui, Liu, Nian
Format:	Preprint
Published:	2026
Subjects:	Numerical Analysis Machine Learning Optimization and Control 65K10, 90C30, 65F08, 68T07
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Hybrid Least Squares/Gradient Descent Methods for DeepONets
by: Choi, Jun, et al.
Published: (2025)

Variable Projected Augmented Lagrangian Methods for Generalized Lasso Problems
by: Aleotti, Stefano, et al.
Published: (2025)

A Neural-Operator Preconditioned Newton Method for Accelerated Nonlinear Solvers
by: Lee, Youngkyu, et al.
Published: (2025)

An Introduction to Solving the Least-Squares Problem in Variational Data Assimilation
by: Daužickaitė, I., et al.
Published: (2025)

Neural Preconditioning via Krylov Subspace Geometry
by: Dimola, Nunzio, et al.
Published: (2025)

A Hybrid Iterative Neural Solver Based on Spectral Analysis for Parametric PDEs
by: Cui, Chen, et al.
Published: (2024)

Preconditioned Low-Rank Riemannian Optimization for Symmetric Positive Definite Linear Matrix Equations
by: Bioli, Ivan, et al.
Published: (2024)

An Augmented Lagrangian Method for Training Recurrent Neural Networks
by: Wang, Yue, et al.
Published: (2024)

EPIC: a provable accelerated Eigensolver based on Preconditioning and Implicit Convexity
by: Shao, Nian, et al.
Published: (2024)

ASPEN: An Additional Sampling Penalty Method for Finite-Sum Optimization Problems with Nonlinear Equality Constraints
by: Krejić, Nataša, et al.
Published: (2025)

A Spectral Preconditioner for the Conjugate Gradient Method with Iteration Budget
by: Diouane, Youssef, et al.
Published: (2026)

A Proximal-Gradient Method for Solving Regularized Optimization Problems with General Constraints
by: Curtis, Frank E., et al.
Published: (2025)

Learning a generalized multiscale prolongation operator
by: Liu, Yucheng, et al.
Published: (2024)

Objective Value Change and Shape-Based Accelerated Optimization for the Neural Network Approximation
by: Xie, Pengcheng, et al.
Published: (2025)

Adaptive Preconditioned Gradient Descent with Energy
by: Liu, Hailiang, et al.
Published: (2023)

Preconditioning of a hybridizable discontinuous Galerkin method for the coupled Stokes--Darcy system
by: Henríquez, Esteban, et al.
Published: (2026)

Faster Adaptive Optimization via Expected Gradient Outer Product Reparameterization
by: DePavia, Adela, et al.
Published: (2025)

An Additively Preconditioned Trust Region Strategy for Machine Learning
by: Alegría, Samuel Cruz, et al.
Published: (2025)

Expansive Natural Neural Gradient Flows for Energy Minimization
by: Dahmen, Wolfgang, et al.
Published: (2025)

Riemannian Acceleration with Preconditioning for symmetric eigenvalue problems
by: Shao, Nian, et al.
Published: (2023)

A Layer Separation Optimization Framework for Cross-Entropy Training in Deep Learning
by: Liu, Yaru, et al.
Published: (2026)

A preconditioned difference of convex functions algorithm with extrapolation and line search
by: Zhang, Ran, et al.
Published: (2025)

Row-Splitting ILU Preconditioners for Sparse Least-Squares Problems
by: Scott, Jennifer, et al.
Published: (2026)

Convergence analysis of iterative solution with inexact block preconditioning for weak Galerkin finite element approximation of Stokes flow
by: Huang, Weizhang, et al.
Published: (2024)

A general regularization strategy for singular Stokes problems and convergence analysis for corresponding discretization and iterative solution
by: Huang, Weizhang, et al.
Published: (2025)

Neural Approximate Inverse Preconditioners
by: Xu, Tianshi, et al.
Published: (2025)

Inexact Riemannian Gradient Descent Method for Nonconvex Optimization
by: Zhou, Juan, et al.
Published: (2024)

An Isogeometric Tearing and Interconnecting method for conforming discretizations of the biharmonic problem
by: Takacs, Stefan
Published: (2025)

Greedy Learning to Optimize with Convergence Guarantees
by: Fahy, Patrick, et al.
Published: (2024)

Rank-one Riemannian Subspace Descent for Nonlinear Matrix Equations
by: Darmwal, Yogesh, et al.
Published: (2026)

Low-rank optimization on Tucker tensor varieties
by: Gao, Bin, et al.
Published: (2023)

Optimization on product manifolds under a preconditioned metric
by: Gao, Bin, et al.
Published: (2023)

An NPDo Approach for Principal Joint SVD-type Block Diagonalization
by: Li, Ren-Cang, et al.
Published: (2026)

Preconditioned subgradient method for composite optimization: overparameterization and fast convergence
by: Díaz, Mateo, et al.
Published: (2025)

The $ω$-Condition Number: Applications to Optimal Preconditioning and Low Rank Generalized Jacobian Updating
by: Jung, Woosuk L., et al.
Published: (2023)

Preconditioning via Randomized Range Deflation (RandRAND)
by: Balabanov, Oleg, et al.
Published: (2025)

Deep Learning Based on Randomized Quasi-Monte Carlo Method for Solving Linear Kolmogorov Partial Differential Equation
by: Xiao, Jichang, et al.
Published: (2023)

Power Homotopy for Zeroth-Order Non-Convex Optimizations
by: Xu, Chen
Published: (2025)

Global Optimization with A Power-Transformed Objective and Gaussian Smoothing
by: Xu, Chen
Published: (2024)

Accelerated Gradient Methods with Gradient Restart: Global Linear Convergence
by: Bao, Chenglong, et al.
Published: (2024)