Cover Image

Why does the two-timescale Q-learning converge to different mean field solutions? A unified convergence analysis

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	An, Jing, Lu, Jianfeng, Wu, Yue, Xiang, Yang
Format:	Preprint
Published:	2024
Subjects:	Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Convergence of two-timescale gradient descent ascent dynamics: finite-dimensional and mean-field perspectives
by: An, Jing, et al.
Published: (2025)

An error bound-based convergence analysis framework for a class of randomized algorithms
by: Yang, Zhichun, et al.
Published: (2026)

Equilibrium convergence in large games
by: Chen, Enxian, et al.
Published: (2020)

Quantitative convergence for mean field control with common noise and degenerate idiosyncratic noise
by: Cecchin, Alekos, et al.
Published: (2024)

Nonconvex optimization and convergence of stochastic gradient descent, and solution of asynchronous game
by: Buck, Kevin, et al.
Published: (2025)

On the convergence analysis of the decentralized projected gradient descent method
by: Choi, Woocheol, et al.
Published: (2023)

Local convergence of mean-field Langevin dynamics: from gradient flows to linearly monotone games
by: Wang, Guillaume, et al.
Published: (2026)

On the convergence of fictitious play algorithm in repeated games via the geometrical approach
by: Wu, Zhouming, et al.
Published: (2024)

Q-quadratic convergence of the centralized circumcentered-reflection method under a relative interior condition
by: Bello-Cruz, Yunier
Published: (2026)

Finite convergence of Moment-SOS relaxations with non-real radical ideals
by: Huang, Lei, et al.
Published: (2023)

On the sequential convergence of Lloyd's algorithms
by: Portales, Léo, et al.
Published: (2024)

On convergence analysis of feedback control with integral action and discontinuous relay perturbation
by: Ruderman, Michael
Published: (2023)

Rate of convergence for first-order singular perturbation problems: Hamilton-Jacobi-Isaacs equations and mean field games of acceleration
by: Cannarsa, Piermarco, et al.
Published: (2024)

On the convergence of conditional gradient method for unbounded multiobjective optimization problems
by: Chen, Wang, et al.
Published: (2024)

Ultra-fast feature learning for the training of two-layer neural networks in the two-timescale regime
by: Barboni, Raphaël, et al.
Published: (2025)

Exponential convergence of multiagent systems with lack of connection
by: Ancona, Fabio, et al.
Published: (2025)

Improved convergence rates for the Difference-of-Convex algorithm
by: Rotaru, Teodor, et al.
Published: (2024)

Non-convergence Analysis of Probabilistic Direct Search
by: Huang, Cunxin, et al.
Published: (2026)

On the (linear) convergence of Generalized Newton Inexact ADMM
by: Frangella, Zachary, et al.
Published: (2023)

On the convergence rate of the Douglas-Rachford splitting algorithm
by: Abbaszadehpeivasti, Hadi, et al.
Published: (2025)

Complexity and convergence analysis of a single-loop SDCAM for Lipschitz composite optimization and beyond
by: Zhang, Hao, et al.
Published: (2025)

Worst-case convergence analysis of relatively inexact gradient descent on smooth convex functions
by: Vernimmen, Pierre, et al.
Published: (2025)

Social optimum of finite mean field games: existence and uniqueness of equilibrium solutions in the finite horizon and stationary solutions in the infinite horizon
by: Niu, Zijia, et al.
Published: (2024)

Almost sure convergence of stochastic Hamiltonian descent methods
by: Williamson, Måns, et al.
Published: (2024)

An inexact inertial projective splitting algorithm with strong convergence
by: Alves, M. Marques, et al.
Published: (2025)

On the convergence rate of the boosted Difference-of-Convex Algorithm (DCA)
by: Abbaszadehpeivasti, Hadi, et al.
Published: (2025)

On rates of convergence for sample average approximations without smoothness
by: Nguyen, Hien Duy, et al.
Published: (2026)

Proximal gradient-type method with generalized distance and convergence analysis without global descent lemma
by: Yagishita, Shotaro, et al.
Published: (2025)

Local convergence analysis of stabilized sequential quadratic programming methods for optimization problems in Banach spaces
by: Yamakawa, Yuya
Published: (2025)

Fast convergence rates and trajectory convergence of a Tikhonov regularized inertial primal\mbox{-}dual dynamical system with time scaling and vanishing damping
by: Zhu, Ting-Ting, et al.
Published: (2024)

A unified solution framework for truck-and-drone routing problems
by: Xu, Ke, et al.
Published: (2026)

Primal-dual policy learning for mean-field stochastic LQR problem
by: Jiang, Xiushan, et al.
Published: (2025)

Exponential convergence under distributed averaging integral frequency control
by: Weitenberg, Erieke, et al.
Published: (2016)

On the exponential convergence of input-output signals of nonlinear feedback systems
by: Su, Lanlan, et al.
Published: (2022)

Modelling and analysis of multi-timescale uncertainty in energy system planning
by: Zhang, Hongyu, et al.
Published: (2024)

Convergence of stochastic gradient descent under a local Lojasiewicz condition for deep neural networks
by: An, Jing, et al.
Published: (2023)

Delayed supermartingale convergence lemmas for stochastic approximation with Nesterov momentum
by: Ming-Kun, Zhang
Published: (2024)

Finite convergence of the Moment-SOS hierarchy for polynomial matrix optimization
by: Huang, Lei, et al.
Published: (2024)

Weak convergence of the stochastic proximal point method in metric spaces
by: Pischke, Nicholas
Published: (2026)

Linearly convergent bilevel optimization with single-step inner methods
by: Suonperä, Ensio, et al.
Published: (2022)