Imagen de Portada

Global Stability and Step Size Robustness of RMSProp

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Dimitrieski, Naum, Honecker, Maria Christine, Scherer, Carsten, Ebenbauer, Christian
Formato:	Preprint
Publicado:	2026
Materias:	Optimization and Control
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Stochastic Gradient Descent for Constrained Optimization based on Adaptive Relaxed Barrier Functions
por: Dimitrieski, Naum, et al.
Publicado: (2025)

Time-delay Induced Stochastic Optimization and Extremum Seeking
por: Dimitrieski, Naum, et al.
Publicado: (2024)

Robust and structure exploiting optimization algorithms: An integral quadratic constraint approach
por: Michalowsky, Simon, et al.
Publicado: (2019)

Distributionally robust LMI synthesis for LTI systems
por: Gramlich, Dennis, et al.
Publicado: (2025)

Inferring Global Exponential Stability Properties using Lie-bracket Approximations
por: Weber, Marc, et al.
Publicado: (2024)

On moment relaxations for linear state feedback controller synthesis with non-convex quadratic costs and constraints
por: Gramlich, Dennis, et al.
Publicado: (2024)

Global Extremum Seeking With Double Integrators in the Presence of Local Extrema
por: Suttner, Raik, et al.
Publicado: (2026)

Global exponential stabilization of a force- and torque-actuated unicycle by flexible-step MPC
por: Kolsi, Ala, et al.
Publicado: (2026)

Distributional Robustness in Output Feedback Regret-Optimal Control
por: Yan, Shuhao, et al.
Publicado: (2025)

Convergence of the Iterates for Momentum and RMSProp for Local Smooth Functions: Adaptation is the Key
por: Bensaid, Bilel, et al.
Publicado: (2024)

Non-Local Extremum Seeking Based on the Divergence Theorem
por: Suttner, Raik, et al.
Publicado: (2026)

Flexible-step Model Predictive Control based on Generalized Lyapunov Functions
por: Fürnsinn, Annika, et al.
Publicado: (2022)

Flexible-step MPC for Switched Linear Systems with No Quadratic Common Lyapunov Function
por: Fürnsinn, Annika, et al.
Publicado: (2024)

Non-overshooting output shaping for switched linear systems under arbitrary switching using eigenstructure assignment
por: Wulff, Kai, et al.
Publicado: (2024)

A Poisson Jump-driven SDE Approach to Distributed Gradient Descent with Sparse Communication
por: Weber, Marc, et al.
Publicado: (2025)

Combining Prior Knowledge and Data for Robust Controller Design
por: Berberich, Julian, et al.
Publicado: (2020)

Integral Quadratic Constraints on Linear Infinite-dimensional Systems for Robust Stability Analysis
por: Barreau, Matthieu, et al.
Publicado: (2020)

Flexible-step MPC for Unknown Linear Time-Invariant Systems
por: Pietschner, Markus, et al.
Publicado: (2025)

Lifting to Passivity for $\mathcal{H}_2$-Gain-Scheduling Synthesis with Full Block Scalings
por: Rösinger, Christian A., et al.
Publicado: (2020)

Gain-Scheduling Controller Synthesis for Nested Systems with Full Block Scalings
por: Rösinger, Christian A., et al.
Publicado: (2022)

Modeling AdaGrad, RMSProp, and Adam with Integro-Differential Equations
por: Heredia, Carlos
Publicado: (2024)

Convergence Guarantees for RMSProp and Adam in Generalized-smooth Non-convex Optimization with Affine Noise Variance
por: Zhang, Qi, et al.
Publicado: (2024)

Analysis and Synthesis of Switched Optimization Algorithms
por: Miller, Jared, et al.
Publicado: (2025)

On Convergence and Stability of Two Extended BB-like Step Sizes
por: Xu, Xin
Publicado: (2025)

On the $O(\frac{\sqrt{d}}{T^{1/4}})$ Convergence Rate of RMSProp and Its Momentum Extension Measured by $\ell_1$ Norm
por: Li, Huan, et al.
Publicado: (2024)

Distributed Inexact Newton Method with Adaptive Step Sizes
por: Jakovetic, Dusan, et al.
Publicado: (2023)

On the Convergence of Projected Policy Gradient for Any Constant Step Sizes
por: Liu, Jiacai, et al.
Publicado: (2023)

Analysis of Gradient Descent with Varying Step Sizes using Integral Quadratic Constraints
por: Padmanabhan, Ram, et al.
Publicado: (2022)

Step-Size Stability in Stochastic Optimization: A Theoretical Perspective
por: Schaipp, Fabian, et al.
Publicado: (2026)

Robust Stability for Multiagent Systems with Spatio-Temporally Correlated Packet Loss
por: Hespe, Christian, et al.
Publicado: (2024)

Global Stability Notions to Enhance the Rigor and Robustness of Adaptive Control
por: Karafyllis, Iasson, et al.
Publicado: (2024)

Monitoring the Convergence Speed of PDHG to Find Better Primal and Dual Step Sizes
por: Fercoq, Olivier
Publicado: (2024)

Multi-objective robust controller synthesis with integral quadratic constraints in discrete-time
por: Schwenkel, Lukas, et al.
Publicado: (2025)

Adaptive Open-Loop Step-Sizes for Accelerated Convergence Rates of the Frank-Wolfe Algorithm
por: Wirth, Elias, et al.
Publicado: (2025)

AdaBatchGrad: Combining Adaptive Batch Size and Adaptive Step Size
por: Ostroukhov, Petr, et al.
Publicado: (2024)

Hybrid Minimum-Seeking in Synergistic Lyapunov Functions: Robust Global Stabilization under Unknown Control Directions
por: Abdelgalil, Mahmoud, et al.
Publicado: (2024)

Safeguarded Stochastic Polyak Step Sizes for Non-smooth Optimization: Robust Performance Without Small (Sub)Gradients
por: Oikonomou, Dimitris, et al.
Publicado: (2025)

Almost Sure Convergence of Stochastic Approximation: An Interplay of Noise and Step Size
por: Nguyen, Quang Dinh Thien, et al.
Publicado: (2026)

Optimal Convergence Rate for Mirror Descent Methods with special Time-Varying Step Sizes Rules
por: Alkousa, Mohammad, et al.
Publicado: (2024)

Accelerated Affine-Invariant Convergence Rates of the Frank-Wolfe Algorithm with Open-Loop Step-Sizes
por: Wirth, Elias, et al.
Publicado: (2023)