Cover Image

PowerStep: Memory-Efficient Adaptive Optimization via $\ell_p$-Norm Steepest Descent

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lu, Yao, Fan, Dengdong, Zhang, Shixun, Tian, Yonghong
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Artificial Intelligence Computation and Language Numerical Analysis Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Stochastic Steepest Descent Method for Robust Optimization in Banach Spaces
by: Chada, Neil K., et al.
Published: (2023)

Wasserstein Steepest Descent Flows of Discrepancies with Riesz Kernels
by: Hertrich, Johannes, et al.
Published: (2022)

Iterative Refinement for $\ell_p$-norm Regression
by: Adil, Deeksha, et al.
Published: (2019)

Convergence Rates for $\ell_p$ Norm Minimization in Convex Vector Optimization
by: Alshahrani, Mohammed
Published: (2026)

Provably Faster Gradient Descent via Long Steps
by: Grimmer, Benjamin
Published: (2023)

Power of $\ell_1$-Norm Regularized Kaczmarz Algorithms for High-Order Tensor Recovery
by: Henneberger, Katherine, et al.
Published: (2024)

An Inexact General Descent Method with Applications in Differential Equation-Constrained Optimization
by: Macedo, Humberto Gimenes, et al.
Published: (2025)

Low-Discrepancy Set Post-Processing via Gradient Descent
by: Clément, François, et al.
Published: (2025)

Projected Block Coordinate Descent for sparse spike estimation
by: Bénard, Pierre-Jean, et al.
Published: (2024)

An Adaptive Phase-Field Method for Structural Topology Optimization
by: Jin, Bangti, et al.
Published: (2023)

On the Width Scaling of Neural Optimizers Under Matrix Operator Norms I: Row/Column Normalization and Hyperparameter Transfer
by: Xu, Ruihan, et al.
Published: (2026)

IRKA is a Riemannian Gradient Descent Method
by: Mlinarić, Petar, et al.
Published: (2023)

Super Gradient Descent: Global Optimization requires Global Gradient
by: Achour, Seifeddine
Published: (2024)

A Cayley-free Two-Step Algorithm for Inverse Singular Value Problems
by: Fan, Jiechang, et al.
Published: (2026)

R-Adaptive Mesh Optimization to Enhance Finite Element Basis Compression
by: Harper, Graham, et al.
Published: (2024)

The Essential Best and Average Rate of Convergence of the Exact Line Search Gradient Descent Method
by: Yu, Thomas
Published: (2023)

Block Acceleration Without Momentum: On Optimal Stepsizes of Block Gradient Descent for Least-Squares
by: Peng, Liangzu, et al.
Published: (2024)

A Homotopy Framework for Constrained Multiobjective Optimization
by: Ogunleye, Olaoluwa, et al.
Published: (2026)

Dynamic Proximal Gradient Algorithms for Schatten-$p$ Quasi-Norm Regularized Problems
by: Shen, Weiping, et al.
Published: (2026)

A New Fast Adaptive Linearized Alternating Direction Multiplier Method for Convex Optimization
by: Wang, Boran
Published: (2024)

Convergence Analysis of an Adaptive Nonconforming FEM for Phase-Field Dependent Topology Optimization in Stokes Flow
by: Jin, Bangti, et al.
Published: (2025)

Adaptive Preconditioned Gradient Descent with Energy
by: Liu, Hailiang, et al.
Published: (2023)

Minimum Flow Steepest Descent Approach for Nonlinear PDE
by: Igbida, Noureddine
Published: (2024)

A Block Coordinate Descent Method for Nonsmooth Composite Optimization under Orthogonality Constraints
by: Yuan, Ganzhao
Published: (2023)

A Single-Loop Gradient Descent and Perturbed Ascent Algorithm for Nonconvex Functional Constrained Optimization
by: Lu, Songtao
Published: (2022)

On the global complexity of a derivative-free Levenberg-Marquardt algorithm via orthogonal spherical smoothing
by: Chen, Xi, et al.
Published: (2024)

A Heterogeneous Multiscale Method for Efficient Simulation of Power Systems with Inverter-Based Resources
by: Huang, Kaiyang, et al.
Published: (2025)

Quasi-Steady-State Approach for Efficient Multiscale Simulation and Optimization of mAb Glycosylation in CHO Cell Culture
by: Ma, Yingjie, et al.
Published: (2024)

On the Convergence of the Gradient Descent Method with Stochastic Fixed-point Rounding Errors under the Polyak-Lojasiewicz Inequality
by: Xia, Lu, et al.
Published: (2023)

Fast Unconstrained Optimization via Hessian Averaging and Adaptive Gradient Sampling Methods
by: O'Leary-Roseberry, Thomas, et al.
Published: (2024)

From PDEs constrained optimization to controllability problems via time domain decomposition
by: Cocquet, Pierre-Henri, et al.
Published: (2026)

Traffic Flow Data Completion and Anomaly Diagnosis via Sparse and Low-Rank Tensor Optimization
by: Man, Junxi, et al.
Published: (2025)

Fast and Provable Tensor-Train Format Tensor Completion via Precondtioned Riemannian Gradient Descent
by: Bian, Fengmiao, et al.
Published: (2025)

Gradient is All You Need? How Consensus-Based Optimization can be Interpreted as a Stochastic Relaxation of Gradient Descent
by: Riedl, Konstantin, et al.
Published: (2023)

Discrete Variable Topology Optimization Using Multi-Cut Formulation and Adaptive Trust Regions
by: Ye, Zisheng, et al.
Published: (2024)

Total variation regularization for recovering the spatial source term in a time-fractional diffusion equation
by: Fan, Bin
Published: (2023)

Adaptive projected SOR algorithms for nonnegative quadratic programming
by: Miyatake, Yuto, et al.
Published: (2021)

BC-ADMM: An Efficient Non-convex Constrained Optimizer with Robotic Applications
by: Pan, Zherong, et al.
Published: (2025)

MAGPIE: Multilevel-Adaptive-Guided Solver for Ptychographic Phase Retrieval
by: Zhang, Borong, et al.
Published: (2025)

Adaptive Proximal Gradient Method for Convex Optimization
by: Malitsky, Yura, et al.
Published: (2023)