Norm-Constrained Flows and Sign-Based Optimization: Theory and Algorithms
Fuente:
arXiv
Saved in:
| Main Authors: | Leplat, Valentin, Mayorga, Sergio, Hildebrand, Roland, Gasnikov, Alexander |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
IRON: Implicit Resolvent Optimization under Noise
by: Leplat, Valentin, et al.
Published: (2026)
by: Leplat, Valentin, et al.
Published: (2026)
The Geometry of Constrained Optimization: Constrained Gradient Flows via Reparameterization: A-Stable Implicit Schemes, KKT from Stationarity, and Geometry-Respecting Algorithms
by: Leplat, Valentin
Published: (2025)
by: Leplat, Valentin
Published: (2025)
Conic-Optimization Based Algorithms for Nonnegative Matrix Factorization
by: Leplat, Valentin, et al.
Published: (2021)
by: Leplat, Valentin, et al.
Published: (2021)
Joint Majorization-Minimization for Nonnegative CP and Tucker Decompositions under $β$-Divergences: Unfolding-Free Updates
by: Leplat, Valentin
Published: (2026)
by: Leplat, Valentin
Published: (2026)
Power of Generalized Smoothness in Stochastic Convex Optimization: First- and Zero-Order Algorithms
by: Lobanov, Aleksandr, et al.
Published: (2025)
by: Lobanov, Aleksandr, et al.
Published: (2025)
Efficient Algorithms for Regularized Nonnegative Scale-invariant Low-rank Approximation Models
by: Cohen, Jeremy E., et al.
Published: (2024)
by: Cohen, Jeremy E., et al.
Published: (2024)
Prox-NAG-GS: A Semi-Implicit Proximal Method for Composite Optimization
by: Wiykiynyuy, Sikeh Gisele, et al.
Published: (2026)
by: Wiykiynyuy, Sikeh Gisele, et al.
Published: (2026)
A Parameter-free Decentralized Algorithm for Composite Convex Optimization
by: Chen, Xiaokai, et al.
Published: (2025)
by: Chen, Xiaokai, et al.
Published: (2025)
Adaptive Algorithms for Relatively Lipschitz Continuous Convex Optimization Problems
by: Stonyakin, Fedor, et al.
Published: (2021)
by: Stonyakin, Fedor, et al.
Published: (2021)
Stochastic Decentralized Optimization of Non-Smooth Convex and Convex-Concave Problems over Time-Varying Networks
by: Divilkovskiy, Maxim, et al.
Published: (2025)
by: Divilkovskiy, Maxim, et al.
Published: (2025)
Accelerated Zero-Order SGD Method for Solving the Black Box Optimization Problem under "Overparametrization" Condition
by: Lobanov, Aleksandr, et al.
Published: (2023)
by: Lobanov, Aleksandr, et al.
Published: (2023)
Distributed Saddle-Point Problems: Lower Bounds, Near-Optimal and Robust Algorithms
by: Beznosikov, Aleksandr, et al.
Published: (2020)
by: Beznosikov, Aleksandr, et al.
Published: (2020)
Acceleration Exists! Optimization Problems When Oracle Can Only Compare Objective Function Values
by: Lobanov, Aleksandr, et al.
Published: (2024)
by: Lobanov, Aleksandr, et al.
Published: (2024)
The Black-Box Optimization Problem: Zero-Order Accelerated Stochastic Method via Kernel Approximation
by: Lobanov, Aleksandr, et al.
Published: (2023)
by: Lobanov, Aleksandr, et al.
Published: (2023)
Numerical analysis of the convex relaxation of the barrier parameter functional of self-concordant barriers
by: Pirau, Vitali, et al.
Published: (2025)
by: Pirau, Vitali, et al.
Published: (2025)
Decentralized Optimization with Mixed Affine Constraints
by: Yarmoshik, Demyan, et al.
Published: (2026)
by: Yarmoshik, Demyan, et al.
Published: (2026)
Lower Bounds and Optimal Algorithms for Non-Smooth Convex Decentralized Optimization over Time-Varying Networks
by: Kovalev, Dmitry, et al.
Published: (2024)
by: Kovalev, Dmitry, et al.
Published: (2024)
Lower and upper bounds of the convergence rate of gradient methods with composite noise in gradient
by: Vasin, Artem, et al.
Published: (2026)
by: Vasin, Artem, et al.
Published: (2026)
Sign Operator for Coping with Heavy-Tailed Noise in Non-Convex Optimization: High Probability Bounds Under $(L_0, L_1)$-Smoothness
by: Kornilov, Nikita, et al.
Published: (2025)
by: Kornilov, Nikita, et al.
Published: (2025)
Dual Smoothing for Decentralized Optimization
by: Rogozin, Alexander, et al.
Published: (2025)
by: Rogozin, Alexander, et al.
Published: (2025)
Adaptive Stepsize Selection in Decentralized Convex Optimization
by: Kuruzov, Ilya, et al.
Published: (2025)
by: Kuruzov, Ilya, et al.
Published: (2025)
Clipping Improves Adam-Norm and AdaGrad-Norm when the Noise Is Heavy-Tailed
by: Chezhegov, Savelii, et al.
Published: (2024)
by: Chezhegov, Savelii, et al.
Published: (2024)
Gradient-Type Methods For Decentralized Optimization Problems With Polyak-Łojasiewicz Condition Over Time-Varying Networks
by: Kuruzov, Ilya, et al.
Published: (2022)
by: Kuruzov, Ilya, et al.
Published: (2022)
Decentralized Optimization with Coupled Constraints
by: Yarmoshik, Demyan, et al.
Published: (2024)
by: Yarmoshik, Demyan, et al.
Published: (2024)
Higher Degree Inexact Model for Optimization problems
by: Alkousa, Mohammad, et al.
Published: (2024)
by: Alkousa, Mohammad, et al.
Published: (2024)
Strengthening the finite characterizations of smooth min-max games
by: Krivchenko, Valery, et al.
Published: (2026)
by: Krivchenko, Valery, et al.
Published: (2026)
Robustifying networks for flow problems against edge failure
by: Klyuchikov, Artyom, et al.
Published: (2025)
by: Klyuchikov, Artyom, et al.
Published: (2025)
Decentralized Finite-Sum Optimization over Time-Varying Networks
by: Metelev, Dmitry, et al.
Published: (2024)
by: Metelev, Dmitry, et al.
Published: (2024)
Stochastic Optimization and Data Science
by: Avetisyan, Arutyun, et al.
Published: (2026)
by: Avetisyan, Arutyun, et al.
Published: (2026)
Optimal Data Splitting in Distributed Optimization for Machine Learning
by: Medyakov, Daniil, et al.
Published: (2024)
by: Medyakov, Daniil, et al.
Published: (2024)
Optimal Analysis of Method with Batching for Monotone Stochastic Finite-Sum Variational Inequalities
by: Pichugin, Alexander, et al.
Published: (2024)
by: Pichugin, Alexander, et al.
Published: (2024)
The Mirror-Prox Sliding Method for Non-smooth decentralized saddle-point problems
by: Kuruzov, Ilya, et al.
Published: (2022)
by: Kuruzov, Ilya, et al.
Published: (2022)
QP Based Constrained Optimization for Reliable PINN Training
by: Williams, Alan, et al.
Published: (2024)
by: Williams, Alan, et al.
Published: (2024)
Implicit Bias of AdamW: $\ell_\infty$ Norm Constrained Optimization
by: Xie, Shuo, et al.
Published: (2024)
by: Xie, Shuo, et al.
Published: (2024)
Linear Convergence Rate in Convex Setup is Possible! Gradient Descent Method Variants under $(L_0,L_1)$-Smoothness
by: Lobanov, Aleksandr, et al.
Published: (2024)
by: Lobanov, Aleksandr, et al.
Published: (2024)
Extragradient Sliding for Composite Non-Monotone Variational Inequalities
by: Emelyanov, Roman, et al.
Published: (2024)
by: Emelyanov, Roman, et al.
Published: (2024)
Nesterov's method of dichotomy via Order Oracle: The problem of optimizing a two-variable function on a square
by: Chervonenkis, Boris, et al.
Published: (2024)
by: Chervonenkis, Boris, et al.
Published: (2024)
Local SGD for Near-Quadratic Problems: Improving Convergence under Unconstrained Noise Conditions
by: Sadchikov, Andrey, et al.
Published: (2024)
by: Sadchikov, Andrey, et al.
Published: (2024)
Accelerated Methods with Compression for Horizontal and Vertical Federated Learning
by: Stanko, Sergey, et al.
Published: (2024)
by: Stanko, Sergey, et al.
Published: (2024)
Universal methods for variational inequalities: deterministic and stochastic cases
by: Klimza, Anton, et al.
Published: (2024)
by: Klimza, Anton, et al.
Published: (2024)
Similar Items
-
IRON: Implicit Resolvent Optimization under Noise
by: Leplat, Valentin, et al.
Published: (2026) -
The Geometry of Constrained Optimization: Constrained Gradient Flows via Reparameterization: A-Stable Implicit Schemes, KKT from Stationarity, and Geometry-Respecting Algorithms
by: Leplat, Valentin
Published: (2025) -
Conic-Optimization Based Algorithms for Nonnegative Matrix Factorization
by: Leplat, Valentin, et al.
Published: (2021) -
Joint Majorization-Minimization for Nonnegative CP and Tucker Decompositions under $β$-Divergences: Unfolding-Free Updates
by: Leplat, Valentin
Published: (2026) -
Power of Generalized Smoothness in Stochastic Convex Optimization: First- and Zero-Order Algorithms
by: Lobanov, Aleksandr, et al.
Published: (2025)