Cover Image

A Note on Stability in Asynchronous Stochastic Approximation without Communication Delays

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Yu, Huizhen, Wan, Yi, Sutton, Richard S.
Format:	Preprint
Published:	2023
Subjects:	Machine Learning Optimization and Control 62L20 (Primary) 93E35, 90C40 (Secondary)
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Asynchronous Stochastic Approximation with Applications to Average-Reward Reinforcement Learning
by: Yu, Huizhen, et al.
Published: (2024)

Average-reward reinforcement learning in semi-Markov decision processes via relative value iteration
by: Yu, Huizhen, et al.
Published: (2025)

A Sequential Testing Problem with Signal Control
by: Campbell, Steven, et al.
Published: (2025)

Sample Complexity of Policy Gradient for Log-Growth Control
by: Pan, Qiuhua, et al.
Published: (2026)

Beyond Bellman: High-Order Generator Regression for Continuous-Time Policy Evaluation
by: Zheng, Yaowei, et al.
Published: (2026)

Stochastic Control with Signatures
by: Bank, P., et al.
Published: (2024)

Stability and Sensitivity Analysis of Relative Temporal-Difference Learning: Extended Version
by: Sakha, Masoud S., et al.
Published: (2026)

On Strategic Measures and Optimality Properties in Discrete-Time Stochastic Control with Universally Measurable Policies
by: Yu, Huizhen
Published: (2022)

Causal Hamilton-Jacobi-Bellman Equations for Anticipative Stochastic Optimal Control
by: Bank, Peter, et al.
Published: (2025)

Non-Expansive Mappings in Two-Time-Scale Stochastic Approximation: Finite-Time Analysis
by: Chandak, Siddharth
Published: (2025)

Weakly-Coupled Multi-Action Restless Bandits -- Exponential Convergence in Probability
by: Fu, Jing, et al.
Published: (2026)

Optimistic Training and Convergence of Q-Learning -- Extended Version
by: Mehta, Prashant, et al.
Published: (2026)

The Gittins index is optimal for dynamic allocation with conditionally independent filtrations
by: Wang, Christopher
Published: (2023)

Average Cost Optimality of Partially Observed MDPS: Contraction of Non-linear Filters, Optimal Solutions and Approximations
by: Demirci, Yunus Emre, et al.
Published: (2023)

Drift Optimization of Regulated Stochastic Models Using Sample Average Approximation
by: Zhou, Zihe, et al.
Published: (2025)

Flow Matching for Efficient and Scalable Data Assimilation
by: Transue, Taos, et al.
Published: (2025)

On the Rate of Gaussian Approximation for Linear Regression Problems
by: Khusainov, Marat, et al.
Published: (2025)

Finite-Time Analysis of Projected Two-Time-Scale Stochastic Approximation
by: Bai, Yitao, et al.
Published: (2026)

Gaussian Approximation and Multiplier Bootstrap for Stochastic Gradient Descent
by: Sheshukova, Marina, et al.
Published: (2025)

Dynamic Programming Principle for Stochastic Control Problems on Riemannian Manifolds
by: Gao, Dingqian, et al.
Published: (2025)

Logarithmic regret in the ergodic Avellaneda-Stoikov market making model
by: Cao, Jialun, et al.
Published: (2024)

Near Optimality of Lipschitz and Smooth Policies in Controlled Diffusions
by: Pradhan, Somnath, et al.
Published: (2024)

Particle Approximation for Conditional Control with Soft Killing
by: Carmona, Rene, et al.
Published: (2025)

Ergodic Risk Sensitive Control of Diffusions under a General Structural Hypothesis
by: Anugu, Sumith Reddy, et al.
Published: (2025)

Optimal control for production inventory system with various cost criterion
by: Golui, Subrata, et al.
Published: (2022)

Stochastic Approximation for Nonlinear Discrete Stochastic Control: Finite-Sample Bounds
by: Nguyen, Hoang Huy, et al.
Published: (2023)

Asymptotically Optimal Policies for Weakly Coupled Markov Decision Processes
by: Goldsztajn, Diego, et al.
Published: (2024)

Nonstationary Distribution Estimation via Wasserstein Probability Flows
by: Anderson, Edward J., et al.
Published: (2025)

Confidence intervals for causal effects in sequential decision making
by: Vovk, Vladimir, et al.
Published: (2026)

Robust Ergodic Control of Jump-Diffusion Systems under Drift and Intensity Uncertainty
by: Azze, Abel, et al.
Published: (2026)

The one-shot problem: Solution to an open question of finite-fuel singular control with discretionary stopping
by: Moriarty, John, et al.
Published: (2024)

Non-local Hamilton-Jacobi-Bellman equations for the stochastic optimal control of path-dependent piecewise deterministic processes
by: Bandini, Elena, et al.
Published: (2024)

Policy Gradient for Continuous-Time Mean-Field Control
by: Bayraktar, Erhan, et al.
Published: (2026)

Existence of Viscosity Solutions to Abstract Cauchy Problems via Nonlinear Semigroups
by: Fuchs, Fabian, et al.
Published: (2025)

Optimal Asymptotic Rates for (Stochastic) Gradient Descent under the Local PL-Condition: A Geometric Approach
by: Kassing, Sebastian, et al.
Published: (2026)

On approximations of stochastic optimal control problems with an application to climate equations
by: Flandoli, Franco, et al.
Published: (2024)

Admission Control for A Single Server Waiting Time Process in Heavy Traffic
by: Xie, Bowen, et al.
Published: (2022)

Update-Aware Robust Optimal Model Predictive Control for Nonlinear Systems
by: Wehbeh, J., et al.
Published: (2025)

Stochastic Control Problems Motivated by Sailboat Trajectory Optimization
by: Ciccarella, Carlo, et al.
Published: (2024)

Discounted MPC and infinite-horizon optimal control under plant-model mismatch: Stability and suboptimality
by: Moldenhauer, Robert H., et al.
Published: (2026)