First- and Second-Order Stochastic Adaptive Regularization with Cubics: High Probability Iteration and Sample Complexity
Fuente:
arXiv
Guardado en:
| Autores principales: | Scheinberg, Katya, Xie, Miaolan |
|---|---|
| Formato: | Preprint |
| Publicado: |
2023
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Asymptotic Convergence and Stability of Adaptive Gradient Methods in Smooth Non-convex Optimization
por: Jin, Ruinan, et al.
Publicado: (2026)
por: Jin, Ruinan, et al.
Publicado: (2026)
Alternating Gradient-Type Algorithm for Bilevel Optimization with Inexact Lower-Level Solutions via Moreau Envelope-based Reformulation
por: Bai, Xiaoning, et al.
Publicado: (2024)
por: Bai, Xiaoning, et al.
Publicado: (2024)
Model-Driven Subspaces for Large-Scale Optimization with Local Approximation Strategy
por: He, Yitong, et al.
Publicado: (2025)
por: He, Yitong, et al.
Publicado: (2025)
A Proximal Stochastic Gradient Method with Adaptive Step Size and Variance Reduction for Convex Composite Optimization
por: Fang, Changjie, et al.
Publicado: (2025)
por: Fang, Changjie, et al.
Publicado: (2025)
A General Recipe for Parameter-Free Nonconvex Optimization via Higher-Order Regularization
por: Marumo, Naoki, et al.
Publicado: (2026)
por: Marumo, Naoki, et al.
Publicado: (2026)
Level Constrained First Order Methods for Function Constrained Optimization
por: Boob, Digvijay, et al.
Publicado: (2022)
por: Boob, Digvijay, et al.
Publicado: (2022)
Flexible block-iterative analysis for the Frank-Wolfe algorithm
por: Braun, Gábor, et al.
Publicado: (2024)
por: Braun, Gábor, et al.
Publicado: (2024)
An Inexact Regularized Proximal Newton Method without Line Search
por: Dahl, Simeon vom, et al.
Publicado: (2024)
por: Dahl, Simeon vom, et al.
Publicado: (2024)
ProxSTORM -- A Stochastic Trust-Region Algorithm for Nonsmooth Optimization
por: Baraldi, Robert J., et al.
Publicado: (2025)
por: Baraldi, Robert J., et al.
Publicado: (2025)
Inexact Proximal Point Algorithms for Zeroth-Order Global Optimization
por: Zhang, Minxin, et al.
Publicado: (2024)
por: Zhang, Minxin, et al.
Publicado: (2024)
A Two Stepsize SQP Method for Nonlinear Equality Constrained Stochastic Optimization
por: O'Neill, Michael J.
Publicado: (2024)
por: O'Neill, Michael J.
Publicado: (2024)
Complexity of an inexact stochastic SQP algorithm for equality constrained optimization
por: O'Neill, Michael J., et al.
Publicado: (2026)
por: O'Neill, Michael J., et al.
Publicado: (2026)
On the Convergence and Complexity of Proximal Gradient and Accelerated Proximal Gradient Methods under Adaptive Gradient Estimation
por: Bollapragada, Raghu, et al.
Publicado: (2025)
por: Bollapragada, Raghu, et al.
Publicado: (2025)
Switching Point Optimization for Abstract Parabolic Equations
por: Buchheim, Christoph, et al.
Publicado: (2026)
por: Buchheim, Christoph, et al.
Publicado: (2026)
A Cubic Regularization Method for Multiobjective Optimization
por: Gonçalves, Douglas S., et al.
Publicado: (2025)
por: Gonçalves, Douglas S., et al.
Publicado: (2025)
Retrospective Approximation Sequential Quadratic Programming for Stochastic Optimization with General Deterministic Nonlinear Constraints
por: Berahas, Albert S., et al.
Publicado: (2025)
por: Berahas, Albert S., et al.
Publicado: (2025)
Non-Convex Self-Concordant Functions: Practical Algorithms and Complexity Analysis
por: Goldfarb, Donald, et al.
Publicado: (2025)
por: Goldfarb, Donald, et al.
Publicado: (2025)
Efficient Implementation of Third-Order Tensor Methods with Adaptive Regularization for Unconstrained Optimization
por: Cartis, Coralia, et al.
Publicado: (2024)
por: Cartis, Coralia, et al.
Publicado: (2024)
Convergence-Guaranteed Algorithms for l1/2-Regularized Quadratic Programs with Assignment Constraints
por: Xie, Lijun, et al.
Publicado: (2025)
por: Xie, Lijun, et al.
Publicado: (2025)
One-parameter Filled Function Method for Non-convex Multi-objective Optimization Problems
por: Adhikary, Bikram, et al.
Publicado: (2026)
por: Adhikary, Bikram, et al.
Publicado: (2026)
Augmented Lagrangian methods for fully convex composite optimization
por: De Marchi, Alberto, et al.
Publicado: (2025)
por: De Marchi, Alberto, et al.
Publicado: (2025)
Trust-Region Method for Optimization of Set-Valued Maps Given by Finitely Many Functions
por: Ghosh, Suprova, et al.
Publicado: (2025)
por: Ghosh, Suprova, et al.
Publicado: (2025)
On the Convergence of Interior-Point Methods for Bound-Constrained Nonlinear Optimization Problems with Noise
por: Dezfulian, Shima, et al.
Publicado: (2024)
por: Dezfulian, Shima, et al.
Publicado: (2024)
Local Convergence Results for Sequential Quadratic Programming with Complementarity Constraints
por: Nurkanović, Armin
Publicado: (2026)
por: Nurkanović, Armin
Publicado: (2026)
A Globally Convergent Method for Computing B-stationary Points of Mathematical Programs with Equilibrium Constraints
por: Nurkanović, Armin, et al.
Publicado: (2025)
por: Nurkanović, Armin, et al.
Publicado: (2025)
A Stochastic Quasi-Newton Method in the Absence of Common Random Numbers
por: Menickelly, Matt, et al.
Publicado: (2023)
por: Menickelly, Matt, et al.
Publicado: (2023)
On the Convergence Rates of Iterative Regularization Algorithms for Composite Bi-Level Optimization
por: Shtern, Shimrit, et al.
Publicado: (2025)
por: Shtern, Shimrit, et al.
Publicado: (2025)
MGProx: A nonsmooth multigrid proximal gradient method with adaptive restriction for strongly convex optimization
por: Ang, Andersen, et al.
Publicado: (2023)
por: Ang, Andersen, et al.
Publicado: (2023)
The Grimmer--Shu--Wang Certificate and the Drori--Teboulle Minimax Constant-Stepsize Bound for $N\ge 3$
por: Zhang, Lixing
Publicado: (2026)
por: Zhang, Lixing
Publicado: (2026)
A cut-and-project perspective for linearized Bregman iterations
por: Dai, Yu-Hong, et al.
Publicado: (2024)
por: Dai, Yu-Hong, et al.
Publicado: (2024)
Riemannian Trust Region Methods for SC$^1$ Minimization
por: Zhang, Chenyu, et al.
Publicado: (2023)
por: Zhang, Chenyu, et al.
Publicado: (2023)
Exploiting cone approximations in an augmented Lagrangian method for conic optimization
por: Fukuda, Mituhiro, et al.
Publicado: (2024)
por: Fukuda, Mituhiro, et al.
Publicado: (2024)
A Second-Order Algorithm Based on Affine Scaling Interior-Point Methods for nonlinear Optimisation with bound constraints
por: Pei, Yonggang, et al.
Publicado: (2026)
por: Pei, Yonggang, et al.
Publicado: (2026)
Mathematical programs with complementarity constraints and application to hyperparameter tuning for nonlinear support vector machines
por: Ward, Samuel, et al.
Publicado: (2025)
por: Ward, Samuel, et al.
Publicado: (2025)
First-order majorization-minimization meets high-order majorant: Boosted inexact high-order forward-backward method
por: Kabgani, Alireza, et al.
Publicado: (2025)
por: Kabgani, Alireza, et al.
Publicado: (2025)
Proximal Gradient Descent Ascent Methods for Nonsmooth Nonconvex-Concave Minimax Problems on Riemannian Manifolds
por: Xie, Xiyuan, et al.
Publicado: (2025)
por: Xie, Xiyuan, et al.
Publicado: (2025)
Shadow splitting methods for nonconvex optimisation: epi-approximation, convergence and saddle point avoidance
por: Atenas, Felipe
Publicado: (2025)
por: Atenas, Felipe
Publicado: (2025)
Understanding the Douglas-Rachford splitting method through the lenses of Moreau-type envelopes
por: Atenas, Felipe
Publicado: (2023)
por: Atenas, Felipe
Publicado: (2023)
MoSSP: A Momentum-Based Single-Loop Stochastic Penalty Method for Nonconvex Constrained DC-Regularized Optimization
por: Li, Luxuan, et al.
Publicado: (2026)
por: Li, Luxuan, et al.
Publicado: (2026)
Fast Frank--Wolfe Algorithms with Adaptive Bregman Step-Size for Weakly Convex Functions
por: Takahashi, Shota, et al.
Publicado: (2025)
por: Takahashi, Shota, et al.
Publicado: (2025)
Ejemplares similares
-
Asymptotic Convergence and Stability of Adaptive Gradient Methods in Smooth Non-convex Optimization
por: Jin, Ruinan, et al.
Publicado: (2026) -
Alternating Gradient-Type Algorithm for Bilevel Optimization with Inexact Lower-Level Solutions via Moreau Envelope-based Reformulation
por: Bai, Xiaoning, et al.
Publicado: (2024) -
Model-Driven Subspaces for Large-Scale Optimization with Local Approximation Strategy
por: He, Yitong, et al.
Publicado: (2025) -
A Proximal Stochastic Gradient Method with Adaptive Step Size and Variance Reduction for Convex Composite Optimization
por: Fang, Changjie, et al.
Publicado: (2025) -
A General Recipe for Parameter-Free Nonconvex Optimization via Higher-Order Regularization
por: Marumo, Naoki, et al.
Publicado: (2026)