Copertina

A Methodology Establishing Linear Convergence of Adaptive Gradient Methods under PL Inequality

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Chakrabarti, Kushal, Baranwal, Mayank
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Artificial Intelligence Optimization and Control
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

On Linear Convergence of PI Consensus Algorithm under the Restricted Secant Inequality
di: Chakrabarti, Kushal, et al.
Pubblicazione: (2023)

Distributed Optimization via Energy Conservation Laws in Dilated Coordinates
di: Baranwal, Mayank, et al.
Pubblicazione: (2024)

On a Gradient Approach to Chebyshev Center Problems with Applications to Function Learning
di: Raghuvanshi, Abhinav, et al.
Pubblicazione: (2026)

A Control Theoretic Framework for Adaptive Gradient Optimizers in Machine Learning
di: Chakrabarti, Kushal, et al.
Pubblicazione: (2022)

Robustness of Iteratively Pre-Conditioned Gradient-Descent Method: The Case of Distributed Linear Regression Problem
di: Chakrabarti, Kushal, et al.
Pubblicazione: (2021)

Iterative Pre-Conditioning for Expediting the Gradient-Descent Method: The Distributed Linear Least-Squares Problem
di: Chakrabarti, Kushal, et al.
Pubblicazione: (2020)

On Model Protection in Federated Learning against Eavesdropping Attacks
di: Maity, Dipankar, et al.
Pubblicazione: (2025)

Global Convergence Guarantees for Federated Policy Gradient Methods with Adversaries
di: Ganesh, Swetha, et al.
Pubblicazione: (2024)

Policy Gradient Methods for Risk-Sensitive Distributional Reinforcement Learning with Provable Convergence
di: Xiao, Minheng, et al.
Pubblicazione: (2024)

On Linear Convergence of Distributed Stochastic Bilevel Optimization over Undirected Networks via Gradient Aggregation
di: Tak, Ajay, et al.
Pubblicazione: (2025)

Enhancing Stochastic Gradient Descent: A Unified Framework and Novel Acceleration Methods for Faster Convergence
di: Deng, Yichuan, et al.
Pubblicazione: (2024)

On the Convergence of (Stochastic) Gradient Descent for Kolmogorov--Arnold Networks
di: Gao, Yihang, et al.
Pubblicazione: (2024)

On Convergence of the Iteratively Preconditioned Gradient-Descent (IPG) Observer
di: Chakrabarti, Kushal, et al.
Pubblicazione: (2024)

Directional Smoothness and Gradient Methods: Convergence and Adaptivity
di: Mishkin, Aaron, et al.
Pubblicazione: (2024)

On the Convergence of Adaptive Gradient Methods for Nonconvex Optimization
di: Zhou, Dongruo, et al.
Pubblicazione: (2018)

Shuffling Heuristic in Variational Inequalities: Establishing New Convergence Guarantees
di: Medyakov, Daniil, et al.
Pubblicazione: (2025)

Provable Acceleration of Nesterov's Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks
di: Liu, Xin, et al.
Pubblicazione: (2022)

Adaptive Primal-Dual Method for Safe Reinforcement Learning
di: Chen, Weiqin, et al.
Pubblicazione: (2024)

Adaptively Robust LLM Inference Optimization under Prediction Uncertainty
di: Chen, Zixi, et al.
Pubblicazione: (2025)

Optimal Local Convergence Rates of Stochastic First-Order Methods under Local $α$-PL
di: Masiha, Saeed, et al.
Pubblicazione: (2024)

Global Convergence and Rich Feature Learning in $L$-Layer Infinite-Width Neural Networks under $μ$P Parametrization
di: Chen, Zixiang, et al.
Pubblicazione: (2025)

Anytime Training with Schedule-Free Spectral Optimization
di: Apte, Anuj, et al.
Pubblicazione: (2026)

Optimal Control Operator Perspective and a Neural Adaptive Spectral Method
di: Feng, Mingquan, et al.
Pubblicazione: (2024)

T-SKM-Net: Trainable Neural Network Framework for Linear Constraint Satisfaction via Sampling Kaczmarz-Motzkin Method
di: Zhu, Haoyu, et al.
Pubblicazione: (2025)

Delightful Policy Gradient
di: Osband, Ian
Pubblicazione: (2026)

Can Adaptive Gradient Methods Converge under Heavy-Tailed Noise? A Case Study of AdaGrad
di: Liu, Zijian
Pubblicazione: (2026)

An Approximate Ascent Approach To Prove Convergence of PPO
di: Doering, Leif, et al.
Pubblicazione: (2026)

Gradient Descent Efficiency Index
di: Dhingra, Aviral
Pubblicazione: (2024)

Delightful Distributed Policy Gradient
di: Osband, Ian
Pubblicazione: (2026)

Robust Control with Gradient Uncertainty
di: Qi, Qian
Pubblicazione: (2025)

A Unified Framework for Gradient Aggregation in Multi-Objective Optimization
di: Hu, Zeou, et al.
Pubblicazione: (2026)

Global Convergence of Multiplicative Updates for the Matrix Mechanism: A Collaborative Proof with Gemini 3
di: Rush, Keith
Pubblicazione: (2026)

Unbiased Gradient Low-Rank Projection
di: Pan, Rui, et al.
Pubblicazione: (2025)

Linear-Quadratic Mean-Field Reinforcement Learning: Convergence of Policy Gradient Methods
di: Carmona, René, et al.
Pubblicazione: (2019)

On the Convergence of the Gradient Descent Method with Stochastic Fixed-point Rounding Errors under the Polyak-Lojasiewicz Inequality
di: Xia, Lu, et al.
Pubblicazione: (2023)

Federated Dynamical Low-Rank Training with Global Loss Convergence Guarantees
di: Schotthöfer, Steffen, et al.
Pubblicazione: (2024)

Convergence of Some Convex Message Passing Algorithms to a Fixed Point
di: Voracek, Vaclav, et al.
Pubblicazione: (2024)

Rod Flow: A Continuous-Time Model for Gradient Descent at the Edge of Stability
di: Regis, Eric, et al.
Pubblicazione: (2026)

In-Expectation Convergence of Stochastic Gradient Methods under Heavy-Tailed Noise
di: Liu, Zijian
Pubblicazione: (2026)

Boosting Gradient Ascent for Continuous DR-submodular Maximization
di: Zhang, Qixin, et al.
Pubblicazione: (2024)