Imagen de Portada

Preconditioning for Accelerated Gradient Descent Optimization and Regularization

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Ye, Qiang
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning Numerical Analysis
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Streaming Krylov-Accelerated Stochastic Gradient Descent
por: Thomas, Stephen
Publicado: (2025)

Accelerating Natural Gradient Descent for PINNs with Randomized Numerical Linear Algebra
por: Bioli, Ivan, et al.
Publicado: (2025)

Preconditioned Additive Gaussian Processes with Fourier Acceleration
por: Wagner, Theresa, et al.
Publicado: (2025)

Super Gradient Descent: Global Optimization requires Global Gradient
por: Achour, Seifeddine
Publicado: (2024)

Gradient Descent as a Perceptron Algorithm: Understanding Dynamics and Implicit Acceleration
por: Tyurin, Alexander
Publicado: (2025)

Preconditioning for Physics-Informed Neural Networks
por: Liu, Songming, et al.
Publicado: (2024)

Gradient is All You Need? How Consensus-Based Optimization can be Interpreted as a Stochastic Relaxation of Gradient Descent
por: Riedl, Konstantin, et al.
Publicado: (2023)

Regularized Stein Variational Gradient Flow
por: He, Ye, et al.
Publicado: (2022)

Provably Faster Gradient Descent via Long Steps
por: Grimmer, Benjamin
Publicado: (2023)

Multi-Preconditioned LBFGS for Training Finite-Basis PINNs
por: Salvadó-Benasco, Marc, et al.
Publicado: (2026)

Deep Learning-Enhanced Preconditioning for Efficient Conjugate Gradient Solvers in Large-Scale PDE Systems
por: Li, Rui, et al.
Publicado: (2024)

Dual Cone Gradient Descent for Training Physics-Informed Neural Networks
por: Hwang, Youngsik, et al.
Publicado: (2024)

Accelerating Legacy Numerical Solvers by Non-intrusive Gradient-based Meta-solving
por: Arisaka, Sohei, et al.
Publicado: (2024)

Preconditioned One-Step Generative Modeling for Bayesian Inverse Problems in Function Spaces
por: Cheng, Zilan, et al.
Publicado: (2026)

Data-Parallel Neural Network Training via Nonlinearly Preconditioned Trust-Region Method
por: Alegría, Samuel A. Cruz, et al.
Publicado: (2025)

Modified Loss of Momentum Gradient Descent: Fine-Grained Analysis
por: Cattaneo, Matias D., et al.
Publicado: (2025)

Towards Quantifying the Preconditioning Effect of Adam
por: Das, Rudrajit, et al.
Publicado: (2024)

A Single-Loop Gradient Descent and Perturbed Ascent Algorithm for Nonconvex Functional Constrained Optimization
por: Lu, Songtao
Publicado: (2022)

Accelerating Conjugate Gradient Solvers for Homogenization Problems with Unitary Neural Operators
por: Herb, Julius, et al.
Publicado: (2025)

Fast and Provable Tensor-Train Format Tensor Completion via Precondtioned Riemannian Gradient Descent
por: Bian, Fengmiao, et al.
Publicado: (2025)

Convergence Analysis of Fractional Gradient Descent
por: Aggarwal, Ashwani
Publicado: (2023)

On the Convergence of the Gradient Descent Method with Stochastic Fixed-point Rounding Errors under the Polyak-Lojasiewicz Inequality
por: Xia, Lu, et al.
Publicado: (2023)

Leveraging Operator Learning to Accelerate Convergence of the Preconditioned Conjugate Gradient Method
por: Kopaničáková, Alena, et al.
Publicado: (2025)

Lattice-based Deep Neural Networks: Regularity and Tailored Regularization
por: Keller, Alexander, et al.
Publicado: (2026)

SVD-Preconditioned Gradient Descent Method for Solving Nonlinear Least Squares Problems
por: Chang, Zhipeng, et al.
Publicado: (2026)

Dynamic Proximal Gradient Algorithms for Schatten-$p$ Quasi-Norm Regularized Problems
por: Shen, Weiping, et al.
Publicado: (2026)

Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models
por: Zhang, Fangzhao, et al.
Publicado: (2024)

A Block Coordinate Descent Method for Nonsmooth Composite Optimization under Orthogonality Constraints
por: Yuan, Ganzhao
Publicado: (2023)

Accelerated Gradient-based Design Optimization Via Differentiable Physics-Informed Neural Operator: A Composites Autoclave Processing Case Study
por: Patel, Janak M., et al.
Publicado: (2025)

Why Does Stochastic Gradient Descent Slow Down in Low-Precision Training?
por: Yun, Vincent-Daniel
Publicado: (2025)

Gradients of Functions of Large Matrices
por: Krämer, Nicholas, et al.
Publicado: (2024)

Adaptive Proximal Gradient Method for Convex Optimization
por: Malitsky, Yura, et al.
Publicado: (2023)

Graph Neural Regularizers for PDE Inverse Problems
por: Lauga, William, et al.
Publicado: (2025)

Adaptive Preconditioned Gradient Descent with Energy
por: Liu, Hailiang, et al.
Publicado: (2023)

An Enhanced Zeroth-Order Stochastic Frank-Wolfe Framework for Constrained Finite-Sum Optimization
por: Ye, Haishan, et al.
Publicado: (2025)

Efficient Differentiable Approximation of Generalized Low-rank Regularization
por: Li, Naiqi, et al.
Publicado: (2025)

A New Combination of Preconditioned Gradient Descent Methods and Vector Extrapolation Techniques for Nonlinear Least-Squares Problems
por: Mouhssine, Abdellatif
Publicado: (2026)

Gradient-free training of recurrent neural networks
por: Bolager, Erik Lien, et al.
Publicado: (2024)

Preconditioned FEM-based Neural Networks for Solving Incompressible Fluid Flows and Related Inverse Problems
por: Griese, Franziska, et al.
Publicado: (2024)

Scalable Acceleration for Classification-Based Derivative-Free Optimization
por: Han, Tianyi, et al.
Publicado: (2023)