Imagen de Portada

Gradient is All You Need? How Consensus-Based Optimization can be Interpreted as a Stochastic Relaxation of Gradient Descent

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Riedl, Konstantin, Klock, Timo, Geldhauser, Carina, Fornasier, Massimo
Formato:	Preprint
Publicado:	2023
Materias:	Machine Learning Numerical Analysis Optimization and Control
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Consensus-Based Optimization Methods Converge Globally
por: Fornasier, Massimo, et al.
Publicado: (2021)

Convergence of Anisotropic Consensus-Based Optimization in Mean-Field Law
por: Fornasier, Massimo, et al.
Publicado: (2021)

Consensus-Based Optimization for Saddle Point Problems
por: Huang, Hui, et al.
Publicado: (2022)

Consensus-Based Optimization with Truncated Noise
por: Fornasier, Massimo, et al.
Publicado: (2023)

Super Gradient Descent: Global Optimization requires Global Gradient
por: Achour, Seifeddine
Publicado: (2024)

Multilevel Stochastic Gradient Descent for Optimal Control Under Uncertainty
por: Baumgarten, Niklas, et al.
Publicado: (2025)

IRKA is a Riemannian Gradient Descent Method
por: Mlinarić, Petar, et al.
Publicado: (2023)

Adaptive Proximal Gradient Method for Convex Optimization
por: Malitsky, Yura, et al.
Publicado: (2023)

Low-Discrepancy Set Post-Processing via Gradient Descent
por: Clément, François, et al.
Publicado: (2025)

The Essential Best and Average Rate of Convergence of the Exact Line Search Gradient Descent Method
por: Yu, Thomas
Publicado: (2023)

Block Acceleration Without Momentum: On Optimal Stepsizes of Block Gradient Descent for Least-Squares
por: Peng, Liangzu, et al.
Publicado: (2024)

The Stochastic Steepest Descent Method for Robust Optimization in Banach Spaces
por: Chada, Neil K., et al.
Publicado: (2023)

On the Convergence of the Gradient Descent Method with Stochastic Fixed-point Rounding Errors under the Polyak-Lojasiewicz Inequality
por: Xia, Lu, et al.
Publicado: (2023)

Provably Faster Gradient Descent via Long Steps
por: Grimmer, Benjamin
Publicado: (2023)

Interpolation-Based Gradient-Error Bounds for Use in Derivative-Free Optimization of Noisy Functions
por: Marchetti, Alejandro G., et al.
Publicado: (2025)

Gradient Descent as a Perceptron Algorithm: Understanding Dynamics and Implicit Acceleration
por: Tyurin, Alexander
Publicado: (2025)

Adaptive Lipschitz-Free Conditional Gradient Methods for Stochastic Composite Nonconvex Optimization
por: Yuan, Ganzhao
Publicado: (2026)

Dual Cone Gradient Descent for Training Physics-Informed Neural Networks
por: Hwang, Youngsik, et al.
Publicado: (2024)

Modified Loss of Momentum Gradient Descent: Fine-Grained Analysis
por: Cattaneo, Matias D., et al.
Publicado: (2025)

All You Need is Group Actions: Advancing Robust Autonomous Planning
por: Basco, Vincenzo
Publicado: (2024)

Global Convergence and Error Propagation in Neural Gradient Flows: A Riemannian Optimization Framework
por: Zheng, Shixin, et al.
Publicado: (2026)

Convergence Analysis of Fractional Gradient Descent
por: Aggarwal, Ashwani
Publicado: (2023)

Fast and Provable Tensor-Train Format Tensor Completion via Precondtioned Riemannian Gradient Descent
por: Bian, Fengmiao, et al.
Publicado: (2025)

Gradient-adjusted underdamped Langevin dynamics for sampling
por: Zuo, Xinzhe, et al.
Publicado: (2024)

A Single-Loop Gradient Descent and Perturbed Ascent Algorithm for Nonconvex Functional Constrained Optimization
por: Lu, Songtao
Publicado: (2022)

An Inexact General Descent Method with Applications in Differential Equation-Constrained Optimization
por: Macedo, Humberto Gimenes, et al.
Publicado: (2025)

Tight Convergence Rates in Gradient Mapping for the Difference-of-Convex Algorithm
por: Rotaru, Teodor, et al.
Publicado: (2025)

A DC-Reformulation for Gradient-$L^0$-Constrained Problems
por: Dittrich, Bastian, et al.
Publicado: (2025)

Adaptive Preconditioned Gradient Descent with Energy
por: Liu, Hailiang, et al.
Publicado: (2023)

CB$^2$O: Consensus-Based Bi-Level Optimization
por: Trillos, Nicolás García, et al.
Publicado: (2024)

Enhanced Adaptive Gradient Algorithms for Nonconvex-PL Minimax Optimization
por: Huang, Feihu, et al.
Publicado: (2023)

Mutual Consensus and its Application in Minimum Cost Consensus Models
por: García-Zamora, Diego, et al.
Publicado: (2025)

Swarm-Based Gradient Descent Method for Non-Convex Optimization
por: Lu, Jingcheng, et al.
Publicado: (2022)

Proximal Gradient-based Low Rank Tensor Decomposition for State Dependent Riccati Equation
por: Jiang, Jiahua, et al.
Publicado: (2026)

Active-Set Identification in Noisy and Stochastic Optimization
por: Curtis, Frank E., et al.
Publicado: (2025)

Numerical Analysis on Neural Network Projected Schemes for Approximating One Dimensional Wasserstein Gradient Flows
por: Zuo, Xinzhe, et al.
Publicado: (2024)

Accelerated Primal-Dual Proximal Gradient Splitting Methods for Convex-Concave Saddle-Point Problems
por: Luo, Hao
Publicado: (2024)

Wasserstein Gradient Flows of the Discrepancy with Distance Kernel on the Line
por: Hertrich, Johannes, et al.
Publicado: (2023)

Randomised Splitting Methods and Stochastic Gradient Descent
por: Shaw, Luke, et al.
Publicado: (2025)

Fast Unconstrained Optimization via Hessian Averaging and Adaptive Gradient Sampling Methods
por: O'Leary-Roseberry, Thomas, et al.
Publicado: (2024)