Imagen de Portada

Quadratic Gradient: A Unified Framework Bridging Gradient Descent and Newton-Type Methods by Synthesizing Hessians and Gradients

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Chiang, John
Formato:	Preprint
Publicado:	2022
Materias:	Optimization and Control Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

First-ish Order Methods: Hessian-aware Scalings of Gradient Descent
por: Smee, Oscar, et al.
Publicado: (2025)

Gauss-Newton Natural Gradient Descent for Shape Learning
por: King, James, et al.
Publicado: (2026)

Corner Gradient Descent
por: Yarotsky, Dmitry
Publicado: (2025)

On Penalty-based Bilevel Gradient Descent Method
por: Shen, Han, et al.
Publicado: (2023)

Adaptive Conditional Gradient Descent
por: Khademi, Abbas, et al.
Publicado: (2025)

$k$-SVD with Gradient Descent
por: Jedra, Yassir, et al.
Publicado: (2025)

Quasi-Quadratic Gradient: A New Direction for Accelerating the BFGS Method in Quasi-Newton Optimization
por: Chiang, John
Publicado: (2026)

Stochastic Adaptive Gradient Descent Without Descent
por: Aujol, Jean-François, et al.
Publicado: (2025)

Enhancing Stochastic Gradient Descent: A Unified Framework and Novel Acceleration Methods for Faster Convergence
por: Deng, Yichuan, et al.
Publicado: (2024)

Anytime Acceleration of Gradient Descent
por: Zhang, Zihan, et al.
Publicado: (2024)

Gradient-Normalized Smoothness for Optimization with Approximate Hessians
por: Semenov, Andrei, et al.
Publicado: (2025)

Nonlinear Stochastic Gradient Descent and Heavy-tailed Noise: A Unified Framework and High-probability Guarantees
por: Armacki, Aleksandar, et al.
Publicado: (2024)

NeST-BO: Fast Local Bayesian Optimization via Newton-Step Targeting of Gradient and Hessian Information
por: Tang, Wei-Ting, et al.
Publicado: (2025)

Stochastic Gradient Descent with Adaptive Data
por: Che, Ethan, et al.
Publicado: (2024)

Stochastic Gradient Descent with Strategic Querying
por: Jiang, Nanfei, et al.
Publicado: (2025)

Unraveling the Gradient Descent Dynamics of Transformers
por: Song, Bingqing, et al.
Publicado: (2024)

Communication-Efficient Gradient Descent-Accent Methods for Distributed Variational Inequalities: Unified Analysis and Local Updates
por: Zhang, Siqi, et al.
Publicado: (2023)

Accelerated Stochastic ExtraGradient: Mixing Hessian and Gradient Similarity to Reduce Communication in Distributed and Federated Learning
por: Bylinkin, Dmitry, et al.
Publicado: (2024)

An Adaptive Stochastic Gradient Method with Non-negative Gauss-Newton Stepsizes
por: Orvieto, Antonio, et al.
Publicado: (2024)

Learning Provably Improves the Convergence of Gradient Descent
por: Song, Qingyu, et al.
Publicado: (2025)

Mirror and Preconditioned Gradient Descent in Wasserstein Space
por: Bonet, Clément, et al.
Publicado: (2024)

Enhancing Fractional Gradient Descent with Learned Optimizers
por: Sobotka, Jan, et al.
Publicado: (2025)

Derivatives of Stochastic Gradient Descent in parametric optimization
por: Iutzeler, Franck, et al.
Publicado: (2024)

Convergence of Alternating Gradient Descent for Matrix Factorization
por: Ward, Rachel, et al.
Publicado: (2023)

Super Gradient Descent: Global Optimization requires Global Gradient
por: Achour, Seifeddine
Publicado: (2024)

Gradient Descent Converges Linearly to Flatter Minima than Gradient Flow in Shallow Linear Networks
por: Beneventano, Pierfrancesco, et al.
Publicado: (2025)

Preconditioned Norms: A Unified Framework for Steepest Descent, Quasi-Newton and Adaptive Methods
por: Veprikov, Andrey, et al.
Publicado: (2025)

Gradient Descent Efficiency Index
por: Dhingra, Aviral
Publicado: (2024)

DoWG Unleashed: An Efficient Universal Parameter-Free Gradient Descent Method
por: Khaled, Ahmed, et al.
Publicado: (2023)

First and Second Order Approximations to Stochastic Gradient Descent Methods with Momentum Terms
por: Lu, Eric
Publicado: (2025)

Linear-Quadratic Mean-Field Reinforcement Learning: Convergence of Policy Gradient Methods
por: Carmona, René, et al.
Publicado: (2019)

Policy Gradient Methods for Discrete Time Linear Quadratic Regulator With Random Parameters
por: Li, Deyue
Publicado: (2023)

Gradient Regularized Newton Boosting Trees with Global Convergence
por: Zozoulenko, Nikita, et al.
Publicado: (2026)

Hessian-guided Perturbed Wasserstein Gradient Flows for Escaping Saddle Points
por: Yamamoto, Naoya, et al.
Publicado: (2025)

Convergence Analysis of Stochastic Gradient Descent with MCMC Estimators
por: Li, Tianyou, et al.
Publicado: (2023)

The Sample Complexity of Gradient Descent in Stochastic Convex Optimization
por: Livni, Roi
Publicado: (2024)

On Gradient Descent Ascent for Nonconvex-Concave Minimax Problems
por: Lin, Tianyi, et al.
Publicado: (2019)

Gradient Descent's Last Iterate is Often (slightly) Suboptimal
por: Kornowski, Guy, et al.
Publicado: (2026)

Non-Euclidean Gradient Descent Operates at the Edge of Stability
por: Islamov, Rustem, et al.
Publicado: (2026)

Adaptive Step Sizes for Preconditioned Stochastic Gradient Descent
por: Köhne, Frederik, et al.
Publicado: (2023)