Cover Image

Natural Gradient VI: Guarantees for Non-Conjugate Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sun, Fangyuan, Fatkhullin, Ilyas, He, Niao
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Optimization and Control 90C26, 90C15 G.1.6
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Taming Nonconvex Stochastic Mirror Descent with General Bregman Divergence
by: Fatkhullin, Ilyas, et al.
Published: (2024)

Global Optimality for Constrained Exploration via Penalty Regularization
by: Wolf, Florian, et al.
Published: (2026)

Stochastic Optimization under Hidden Convexity
by: Fatkhullin, Ilyas, et al.
Published: (2023)

Global Solutions to Non-Convex Functional Constrained Problems with Hidden Convexity
by: Fatkhullin, Ilyas, et al.
Published: (2025)

Anisotropic Gaussian Smoothing for Gradient-based Optimization
by: Starnes, Andrew, et al.
Published: (2024)

Adaptive Conditional Forest Sampling for Spectral Risk Optimisation under Decision-Dependent Uncertainty
by: Kurbucz, Marcell T.
Published: (2026)

Adaptive Stochastic Gradient Descent Ascent Algorithm for Nonconvex Minimax Problems with Decision-Dependent Distributions
by: Gao, Yan, et al.
Published: (2025)

A cutting plane algorithm for globally solving low dimensional k-means clustering problems
by: Ryner, Martin, et al.
Published: (2024)

A Structured Tour of Optimization with Finite Differences
by: Rando, Marco, et al.
Published: (2025)

Adaptive Methods for Multiobjective Unit Commitment
by: Tevruez, Ece, et al.
Published: (2025)

Last-iterate Convergence of ADMM on Multi-affine Quadratic Equality Constrained Problem
by: Chao, Yutong, et al.
Published: (2026)

Stochastic convergence of parallel asynchronous adaptive first-order methods
by: Gratton, Serge, et al.
Published: (2026)

OPM, a collection of Optimization Problems in Matlab
by: Gratton, Serge, et al.
Published: (2021)

Multi-Objective Optimization and Hyperparameter Tuning With Desirability Functions
by: Bartz-Beielstein, Thomas
Published: (2025)

Barrier Algorithms for Constrained Non-Convex Optimization
by: Dvurechensky, Pavel, et al.
Published: (2024)

Multi-Objective Optimization with Desirability and Morris-Mitchell Criterion
by: Bartz-Beielstein, Thomas, et al.
Published: (2025)

A unified convergence theory for adaptive first-order methods in the nonconvex case, including AdaNorm, full and diagonal AdaGrad, Shampoo and Muo
by: Gratton, S., et al.
Published: (2026)

Complexity of Adagrad and other first-order methods for nonconvex optimization problems with bounds constraints
by: Gratton, Serge, et al.
Published: (2024)

Complexity and performance for two classes of noise-tolerant first-order algorithms
by: Gratton, S., et al.
Published: (2022)

$\texttt{skwdro}$: a library for Wasserstein distributionally robust machine learning
by: Vincent, Florian, et al.
Published: (2024)

Comparative Evaluation of SDP, SOCP, and QC Convex Relaxations for Large-Scale Market-Based AC Optimal Power Flow
by: Keskin, Ata
Published: (2026)

Zeroth-Order Methods for Nonconvex Stochastic Problems with Decision-Dependent Distributions
by: Hikima, Yuya, et al.
Published: (2024)

Convex Mixed-Integer Nonlinear Programs Derived from Generalized Disjunctive Programming using Cones
by: Neira, David E. Bernal, et al.
Published: (2021)

Refining Graphical Neural Network Predictions Using Flow Matching for Optimal Power Flow with Constraint-Satisfaction Guarantee
by: Khanal, Kshitiz
Published: (2025)

High Probability Guarantees for Random Reshuffling
by: Yu, Hengxu, et al.
Published: (2023)

Regularized Step Directions in Nonlinear Conjugate Gradient Methods
by: Buhler, Cassidy K., et al.
Published: (2021)

A Normal Map-Based Proximal Stochastic Gradient Method: Convergence and Identification Properties
by: Qiu, Junwen, et al.
Published: (2023)

Quadratic Programming over Linearly Ordered Fields: Decidability and Attainment of Optimal Solutions
by: Plutenko, Dmytro O.
Published: (2026)

A reliability-aware randomized simheuristic for the stochastic team orienteering problem
by: Circelli, Michele
Published: (2026)

A Structured Proximal Stochastic Variance Reduced Zeroth-order Algorithm
by: Rando, Marco, et al.
Published: (2025)

Stochastic Gradient Descent Revisited
by: Louzi, Azar
Published: (2024)

Black-Box Uniform Stability for Non-Euclidean Empirical Risk Minimization
by: Vary, Simon, et al.
Published: (2024)

Interior-Point Vanishing Problem in Semidefinite Relaxations for Neural Network Verification
by: Ueda, Ryota, et al.
Published: (2025)

Revenue Optimization with Price-Sensitive and Interdependent Demand
by: Laasri, Julien, et al.
Published: (2025)

Stochastic First-Order Methods with Non-smooth and Non-Euclidean Proximal Terms for Nonconvex High-Dimensional Stochastic Optimization
by: Xie, Yue, et al.
Published: (2024)

Where's Ben Nevis? A 2D optimisation benchmark with 957,174 local optima based on Great Britain terrain data
by: Wei, Yuhang, et al.
Published: (2024)

Escaping Saddle Points via Curvature-Calibrated Perturbations: A Complete Analysis with Explicit Constants and Empirical Validation
by: Alpay, Faruk, et al.
Published: (2025)

Pseudoconvex Problems in Operational Decision Systems: Algorithms for Joint Learning and Optimization
by: Li, Zijun, et al.
Published: (2026)

A globally convergent SQP-type method with least constraint violation for nonlinear semidefinite programming
by: Fu, Wenhao, et al.
Published: (2023)

Zeroth-order gradient estimators for stochastic problems with decision-dependent distributions
by: Hikima, Yuya, et al.
Published: (2025)