Cover Image

Markovian Foundations for Quasi-Stochastic Approximation in Two Timescales: Extended Version

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lauand, Caio Kalil, Meyn, Sean
Format:	Preprint
Published:	2024
Subjects:	Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Markovian Foundations for Quasi-Stochastic Approximation with Applications to Extremum Seeking Control
by: Lauand, Caio Kalil, et al.
Published: (2022)

Global Convergence and Acceleration for Single Observation Gradient Free Optimization
by: Lauand, Caio Kalil, et al.
Published: (2025)

Extremely Fast Convergence Rates for Extremum Seeking Control with Polyak-Ruppert Averaging
by: Lauand, Caio Kalil, et al.
Published: (2022)

Stochastic Online Feedback Optimization for Networks of Non-Compliant Agents
by: Lauand, Caio Kalil, et al.
Published: (2025)

Revisiting Step-Size Assumptions in Stochastic Approximation
by: Lauand, Caio Kalil, et al.
Published: (2024)

Central Limit Theorem for Two-Timescale Stochastic Approximation with Markovian Noise: Theory and Applications
by: Hu, Jie, et al.
Published: (2024)

Optimistic Training and Convergence of Q-Learning -- Extended Version
by: Mehta, Prashant, et al.
Published: (2026)

The case for and against fixed step-size: Stochastic approximation algorithms in optimization and machine learning
by: Lauand, Caio Kalil, et al.
Published: (2023)

Reinforcement Learning for Optimal Stopping in POMDPs with Application to Quickest Change Detection
by: Cooper, Austin, et al.
Published: (2025)

Stability and Sensitivity Analysis of Relative Temporal-Difference Learning: Extended Version
by: Sakha, Masoud S., et al.
Published: (2026)

Reinforcement Learning Design for Quickest Change Detection
by: Cooper, Austin, et al.
Published: (2024)

Two-Timescale Linear Stochastic Approximation: Constant Stepsizes Go a Long Way
by: Kwon, Jeongyeol, et al.
Published: (2024)

Moment Constrained Optimal Transport for Control Applications
by: Corre, Thomas Le, et al.
Published: (2022)

Two-Timescale Asymptotic Simulations of Hybrid Inclusions with Applications to Stochastic Hybrid Optimization
by: Crisafulli, Max F., et al.
Published: (2026)

Gaussian Approximation for Two-Timescale Linear Stochastic Approximation
by: Butyrin, Bogdan, et al.
Published: (2025)

Tight Finite Time Bounds of Two-Time-Scale Linear Stochastic Approximation with Markovian Noise
by: Haque, Shaan Ul, et al.
Published: (2023)

Revisiting the Constant Stepsize Stochastic Approximation with Decision-Dependent Markovian Noise
by: Hadavi, Hadi, et al.
Published: (2026)

Finite-Time Bounds for Two-Time-Scale Stochastic Approximation with Arbitrary Norm Contractions and Markovian Noise
by: Chandak, Siddharth, et al.
Published: (2025)

Functional role of synchronization: A mean-field control perspective
by: Mehta, Prashant, et al.
Published: (2025)

Stochastic Approximation with Unbounded Markovian Noise: A General-Purpose Theorem
by: Haque, Shaan Ul, et al.
Published: (2024)

Computing the Bias of Constant-step Stochastic Approximation with Markovian Noise
by: Allmeier, Sebastian, et al.
Published: (2024)

Bias and Extrapolation in Markovian Linear Stochastic Approximation with Constant Stepsizes
by: Huo, Dongyan, et al.
Published: (2022)

Concentration of General Stochastic Approximation Under Heavy-Tailed Markovian Noise
by: Agrawal, Shubhada, et al.
Published: (2026)

Methods for Solving Variational Inequalities with Markovian Stochasticity
by: Solodkin, Vladimir, et al.
Published: (2024)

Almost Sure Convergence Rates and Concentration of Stochastic Approximation and Reinforcement Learning with Markovian Noise
by: Qian, Xiaochi, et al.
Published: (2024)

Elliptical Pursuit and Evasion -Extended Version-
by: Yoshihara, Sota
Published: (2024)

Scalable Two-Stage Stochastic Optimal Power Flow via Separable Approximation
by: Lamichhane, Shishir, et al.
Published: (2025)

Stochastic-Constrained Stochastic Optimization with Markovian Data
by: Kim, Yeongjong, et al.
Published: (2023)

Asymptotic and Finite Sample Analysis of Nonexpansive Stochastic Approximations with Markovian Noise
by: Blaser, Ethan, et al.
Published: (2024)

Policy Evaluation in Distributional LQR (Extended Version)
by: Wang, Zifan, et al.
Published: (2023)

Methods for Optimization Problems with Markovian Stochasticity and Non-Euclidean Geometry
by: Solodkin, Vladimir, et al.
Published: (2024)

A Two-Timescale Decision-Hazard-Decision Formulation for Storage Usage Values Calculation
by: Parra, Camila Martinez, et al.
Published: (2024)

Achieving Tighter Finite-Time Rates for Heterogeneous Federated Stochastic Approximation under Markovian Sampling
by: Zhu, Feng, et al.
Published: (2025)

Subspace Quasi-Newton Method with Gradient Approximation
by: Miyaishi, Taisei, et al.
Published: (2024)

Stochastic Approximation with Delayed Updates: Finite-Time Rates under Markovian Sampling
by: Adibi, Arman, et al.
Published: (2024)

Sample Complexity of Data-driven Multistage Stochastic Programming under Markovian Uncertainty
by: Park, Hyuk, et al.
Published: (2024)

Towards Global Solutions for Nonconvex Two-Stage Stochastic Programs: A Polynomial Lower Approximation Approach
by: Zhong, Suhan, et al.
Published: (2023)

Lecture Notes on Control System Theory and Design
by: Basar, Tamer, et al.
Published: (2020)

Value Maximization under Stochastic Quasi-Hyperbolic Discounting
by: Yan, Kaixin, et al.
Published: (2024)

An Error-Based Safety Buffer for Safe Adaptive Control (Extended Version)
by: Fisher, Peter A., et al.
Published: (2025)