Quasi-Quadratic Gradient: A New Direction for Accelerating the BFGS Method in Quasi-Newton Optimization
Fuente:
arXiv
Saved in:
| Main Author: | Chiang, John |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Statistical and Computational Complexities of BFGS Quasi-Newton Method for Generalized Linear Models
by: Jin, Qiujiang, et al.
Published: (2022)
by: Jin, Qiujiang, et al.
Published: (2022)
Quadratic Gradient: A Unified Framework Bridging Gradient Descent and Newton-Type Methods by Synthesizing Hessians and Gradients
by: Chiang, John
Published: (2022)
by: Chiang, John
Published: (2022)
Subspace Quasi-Newton Method with Gradient Approximation
by: Miyaishi, Taisei, et al.
Published: (2024)
by: Miyaishi, Taisei, et al.
Published: (2024)
Zeroth-order Gradient and Quasi-Newton Methods for Nonsmooth Nonconvex Stochastic Optimization
by: Marrinan, Luke, et al.
Published: (2023)
by: Marrinan, Luke, et al.
Published: (2023)
Distributed Quasi-Newton Method for Multi-Agent Optimization
by: Shorinwa, Ola, et al.
Published: (2024)
by: Shorinwa, Ola, et al.
Published: (2024)
Efficient Gradient-Enhanced Bayesian Optimizer with Comparisons to Conjugate-Gradient and Quasi-Newton Optimizers for Unconstrained Local Optimization
by: Marchildon, André L., et al.
Published: (2025)
by: Marchildon, André L., et al.
Published: (2025)
Decentralized Conjugate Gradient and Memoryless BFGS Methods
by: Wang, Liping, et al.
Published: (2024)
by: Wang, Liping, et al.
Published: (2024)
Quasi-Newton Methods for Topology Optimization Using a Level-Set Method
by: Blauth, Sebastian, et al.
Published: (2023)
by: Blauth, Sebastian, et al.
Published: (2023)
A Framework for Nonlinearly-Constrained Gradient-Enhanced Local Bayesian Optimization with Comparisons to Quasi-Newton Optimizers
by: Marchildon, André L., et al.
Published: (2025)
by: Marchildon, André L., et al.
Published: (2025)
MUSIC: Accelerated Convergence for Distributed Optimization With Inexact and Exact Methods
by: Wu, Mou, et al.
Published: (2024)
by: Wu, Mou, et al.
Published: (2024)
A Riemannian Optimization Perspective of the Gauss-Newton Method for Feedforward Neural Networks
by: Cayci, Semih
Published: (2024)
by: Cayci, Semih
Published: (2024)
A Decentralized Primal-Dual Method with Quasi-Newton Tracking
by: Wang, Liping, et al.
Published: (2023)
by: Wang, Liping, et al.
Published: (2023)
The Newton-Muon Optimizer
by: Du, Zhehang, et al.
Published: (2026)
by: Du, Zhehang, et al.
Published: (2026)
A Proximal Modified Quasi-Newton Method for Nonsmooth Regularized Optimization
by: Diouane, Youssef, et al.
Published: (2024)
by: Diouane, Youssef, et al.
Published: (2024)
Provable Acceleration of Nesterov's Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks
by: Liu, Xin, et al.
Published: (2022)
by: Liu, Xin, et al.
Published: (2022)
Sharpened Lazy Incremental Quasi-Newton Method
by: Lahoti, Aakash, et al.
Published: (2023)
by: Lahoti, Aakash, et al.
Published: (2023)
Modified Quasi-Newton Method for Nonconvex Multiobjective Optimization Problems with Barzilai-Borwein diagonal matrix
by: Liu, Hua
Published: (2025)
by: Liu, Hua
Published: (2025)
A Quasi-Newton Method to Solve Uncertain Multiobjective Optimization Problems with Uncertainty Set of Finite Cardinality
by: Gupta, K., et al.
Published: (2025)
by: Gupta, K., et al.
Published: (2025)
Enhancing Stochastic Gradient Descent: A Unified Framework and Novel Acceleration Methods for Faster Convergence
by: Deng, Yichuan, et al.
Published: (2024)
by: Deng, Yichuan, et al.
Published: (2024)
Advancing Multi-Secant Quasi-Newton Methods for General Convex Functions
by: Lee, Mokhwa, et al.
Published: (2025)
by: Lee, Mokhwa, et al.
Published: (2025)
Proximal Quasi-Newton Method for Composite Optimization over the Stiefel Manifold
by: Wang, Qinsi, et al.
Published: (2025)
by: Wang, Qinsi, et al.
Published: (2025)
Adaptive Multilevel Newton: A Quadratically Convergent Optimization Method
by: Tsipinakis, Nick, et al.
Published: (2023)
by: Tsipinakis, Nick, et al.
Published: (2023)
A Stochastic Quasi-Newton Method for Non-convex Optimization with Non-uniform Smoothness
by: Sun, Zhenyu, et al.
Published: (2024)
by: Sun, Zhenyu, et al.
Published: (2024)
GLinSAT: The General Linear Satisfiability Neural Network Layer By Accelerated Gradient Descent
by: Zeng, Hongtai, et al.
Published: (2024)
by: Zeng, Hongtai, et al.
Published: (2024)
How Well Can Transformers Emulate In-context Newton's Method?
by: Giannou, Angeliki, et al.
Published: (2024)
by: Giannou, Angeliki, et al.
Published: (2024)
Deterministic Policy Gradient Primal-Dual Methods for Continuous-Space Constrained MDPs
by: Rozada, Sergio, et al.
Published: (2024)
by: Rozada, Sergio, et al.
Published: (2024)
Inertial Quasi-Newton Methods for Monotone Inclusion: Efficient Resolvent Calculus and Primal-Dual Methods
by: Wang, Shida, et al.
Published: (2022)
by: Wang, Shida, et al.
Published: (2022)
Incremental Quasi-Newton Methods with Faster Superlinear Convergence Rates
by: Liu, Zhuanghua, et al.
Published: (2024)
by: Liu, Zhuanghua, et al.
Published: (2024)
Simple Stepsize for Quasi-Newton Methods with Global Convergence Guarantees
by: Agafonov, Artem, et al.
Published: (2025)
by: Agafonov, Artem, et al.
Published: (2025)
An Oracle Gradient Regularized Newton Method for Quadratic Measurements Regression
by: Fan, Jun, et al.
Published: (2022)
by: Fan, Jun, et al.
Published: (2022)
General Proximal Quasi-Newton Methods based on model functions for nonsmooth nonconvex problems
by: Jia, Xiaoxi
Published: (2025)
by: Jia, Xiaoxi
Published: (2025)
A Bifidelity Proximal Quasi-Newton Method for Dense Rigid Body Suspension Collision Resolution
by: Rummel, Nicholas, et al.
Published: (2026)
by: Rummel, Nicholas, et al.
Published: (2026)
A Quasi-Newton Primal-Dual Algorithm with Line Search
by: Wang, Shida, et al.
Published: (2024)
by: Wang, Shida, et al.
Published: (2024)
Accelerated Alternating Direction Method of Multipliers Gradient Tracking for Distributed Optimization
by: Sebastián, Eduardo, et al.
Published: (2024)
by: Sebastián, Eduardo, et al.
Published: (2024)
Parameter-Free Accelerated Quasi-Newton Method for Nonconvex Optimization
by: Marumo, Naoki
Published: (2025)
by: Marumo, Naoki
Published: (2025)
A Diagonal BFGS Update Algorithm with Inertia Acceleration Technology for Minimizations
by: Luo, Zhenhua, et al.
Published: (2024)
by: Luo, Zhenhua, et al.
Published: (2024)
Quasi-difference-convexity: Modernization of Quasi-differentiable Optimization
by: Pang, Jong-Shi, et al.
Published: (2025)
by: Pang, Jong-Shi, et al.
Published: (2025)
Sparse Quadratically Constrained Quadratic Programming via Semismooth Newton Method
by: Li, Shuai, et al.
Published: (2025)
by: Li, Shuai, et al.
Published: (2025)
Quasi-Newton method of Optimization is proved to be a steepest descent method under the ellipsoid norm
by: Li, Jiongcheng
Published: (2024)
by: Li, Jiongcheng
Published: (2024)
Improved Complexity for Smooth Nonconvex Optimization: A Two-Level Online Learning Approach with Quasi-Newton Methods
by: Jiang, Ruichen, et al.
Published: (2024)
by: Jiang, Ruichen, et al.
Published: (2024)
Similar Items
-
Statistical and Computational Complexities of BFGS Quasi-Newton Method for Generalized Linear Models
by: Jin, Qiujiang, et al.
Published: (2022) -
Quadratic Gradient: A Unified Framework Bridging Gradient Descent and Newton-Type Methods by Synthesizing Hessians and Gradients
by: Chiang, John
Published: (2022) -
Subspace Quasi-Newton Method with Gradient Approximation
by: Miyaishi, Taisei, et al.
Published: (2024) -
Zeroth-order Gradient and Quasi-Newton Methods for Nonsmooth Nonconvex Stochastic Optimization
by: Marrinan, Luke, et al.
Published: (2023) -
Distributed Quasi-Newton Method for Multi-Agent Optimization
by: Shorinwa, Ola, et al.
Published: (2024)