Cover Image

Non-Asymptotic Convergence of Stochastic Iterative Algorithms: A Lyapunov Framework

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Chen, Zaiwei, Maguluri, Siva Theja
Format:	Preprint
Published:	2026
Subjects:	Machine Learning Probability
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Non-Asymptotic Theory of Seminorm Lyapunov Stability: From Deterministic to Stochastic Iterative Algorithms
by: Chen, Zaiwei, et al.
Published: (2025)

Concentration of General Stochastic Approximation Under Heavy-Tailed Markovian Noise
by: Agrawal, Shubhada, et al.
Published: (2026)

Concentration of Contractive Stochastic Approximation: Additive and Multiplicative Noise
by: Chen, Zaiwei, et al.
Published: (2023)

Markov Chain Variance Estimation: A Stochastic Approximation Approach
by: Agrawal, Shubhada, et al.
Published: (2024)

Steady-State Behavior of Constant-Stepsize Stochastic Approximation: Gaussian Approximation and Tail Bounds
by: Wang, Zedong, et al.
Published: (2026)

Convergence Rate of the Join-the-Shortest-Queue System
by: Ma, Yuanzhe, et al.
Published: (2025)

From Set Convergence to Pointwise Convergence: Finite-Time Guarantees for Average-Reward Q-Learning with Adaptive Stepsizes
by: Chen, Zaiwei, et al.
Published: (2025)

Tail Bounds for Queues with Abandonment: Constant, Moderate, Large Deviations, and Efficient Concentration
by: Wang, Zedong, et al.
Published: (2026)

A Heavy Traffic Theory of Matching Queues
by: Varma, Sushil Mahavir, et al.
Published: (2021)

How Accurately Can a Gaussian Approximate Stochastic Approximation Iterates?
by: Haque, Shaan Ul, et al.
Published: (2026)

Stochastic Approximation with Unbounded Markovian Noise: A General-Purpose Theorem
by: Haque, Shaan Ul, et al.
Published: (2024)

Convergence of Natural Policy Gradient for a Family of Infinite-State Queueing MDPs
by: Grosof, Isaac, et al.
Published: (2024)

Almost Sure Convergence of Stochastic Approximation: An Interplay of Noise and Step Size
by: Nguyen, Quang Dinh Thien, et al.
Published: (2026)

Higher-Order Approximations of Sojourn Times in M/G/1 Queues via Stein's Method
by: Chatterjee, Bihan, et al.
Published: (2026)

Power-of-$d$ Choices Load Balancing in the Sub-Halfin Whitt Regime
by: Varma, Sushil Mahavir, et al.
Published: (2022)

Federated Stochastic Approximation under Markov Noise and Heterogeneity: Applications in Reinforcement Learning
by: Khodadadian, Sajad, et al.
Published: (2022)

Tight Finite Time Bounds of Two-Time-Scale Linear Stochastic Approximation with Markovian Noise
by: Haque, Shaan Ul, et al.
Published: (2023)

Dynamic Pricing and Matching for Two-Sided Queues
by: Varma, Sushil Mahavir, et al.
Published: (2019)

Finite-Time Behavior of Erlang-C Model: Mixing Time, Mean Queue Length and Tail Bounds
by: Nguyen, Hoang Huy, et al.
Published: (2025)

Exponential Convergence Guarantees for Iterative Markovian Fitting
by: Silveri, Marta Gentiloni, et al.
Published: (2025)

Performance of NPG in Countable State-Space Average-Cost RL
by: Murthy, Yashaswini, et al.
Published: (2024)

Convergence, Sticking and Escape: Stochastic Dynamics Near Critical Points in SGD
by: Dudukalov, Dmitry, et al.
Published: (2025)

Stochastic Approximation for Nonlinear Discrete Stochastic Control: Finite-Sample Bounds
by: Nguyen, Hoang Huy, et al.
Published: (2023)

Natural Policy Gradient as Doubly Smoothed Policy Iteration: A Bellman-Operator Framework
by: Nanda, Phalguni, et al.
Published: (2026)

On Convergence of the Alternating Directions SGHMC Algorithm
by: Ghosh, Soumyadip, et al.
Published: (2024)

Convergent Stochastic Training of Attention and Understanding LoRA
by: Sun, Zhengkai, et al.
Published: (2026)

Last-Iterate Convergence of Payoff-Based Independent Learning in Zero-Sum Stochastic Games
by: Chen, Zaiwei, et al.
Published: (2024)

Stochastic Gradient Descent in Non-Convex Problems: Asymptotic Convergence with Relaxed Step-Size via Stopping Time Methods
by: Jin, Ruinan, et al.
Published: (2025)

Optimization, Isoperimetric Inequalities, and Sampling via Lyapunov Potentials
by: Chen, August Y., et al.
Published: (2024)

Controlling the Flow: Stability and Convergence for Stochastic Gradient Descent with Decaying Regularization
by: Kassing, Sebastian, et al.
Published: (2025)

Deep Learning for Markov Chains: Lyapunov Functions, Poisson's Equation, and Stationary Distributions
by: Qu, Yanlin, et al.
Published: (2025)

Convergence of Two Time-Scale Stochastic Approximation: A Martingale Approach
by: Vidyasagar, Mathukumalli
Published: (2026)

Fooling Algorithms in Non-Stationary Bandits using Belief Inertia
by: Mendelson, Gal, et al.
Published: (2025)

Weak Convergence Analysis of Online Neural Actor-Critic Algorithms
by: Lam, Samuel Chun-Hei, et al.
Published: (2024)

Non-Asymptotic Analysis of Data Augmentation for Precision Matrix Estimation
by: Morisset, Lucas, et al.
Published: (2025)

Fast Conditional Mixing of MCMC Algorithms for Non-log-concave Distributions
by: Cheng, Xiang, et al.
Published: (2023)

Non-Reversible Langevin Algorithms for Constrained Sampling
by: Du, Hengrong, et al.
Published: (2025)

Beyond Propagation of Chaos: A Stochastic Algorithm for Mean Field Optimization
by: Tankala, Chandan, et al.
Published: (2025)

Stochastic Operator Network: A Stochastic Maximum Principle Based Approach to Operator Learning
by: Bausback, Ryan, et al.
Published: (2025)

Asymptotic Gaussian Fluctuations of Eigenvectors in Spectral Clustering
by: Lebeau, Hugo, et al.
Published: (2024)