Imagen de Portada

From Set Convergence to Pointwise Convergence: Finite-Time Guarantees for Average-Reward Q-Learning with Adaptive Stepsizes

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Chen, Zaiwei, Nanda, Phalguni
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Probability
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

A Minimal-Assumption Analysis of Q-Learning with Time-Varying Policies
por: Nanda, Phalguni, et al.
Publicado: (2025)

Natural Policy Gradient as Doubly Smoothed Policy Iteration: A Bellman-Operator Framework
por: Nanda, Phalguni, et al.
Publicado: (2026)

Non-Asymptotic Convergence of Stochastic Iterative Algorithms: A Lyapunov Framework
por: Chen, Zaiwei, et al.
Publicado: (2026)

Exponential Convergence Guarantees for Iterative Markovian Fitting
por: Silveri, Marta Gentiloni, et al.
Publicado: (2025)

Wasserstein Convergence Guarantees for a General Class of Score-Based Generative Models
por: Gao, Xuefeng, et al.
Publicado: (2023)

Achieving $\varepsilon^{-2}$ Dependence for Average-Reward Q-Learning with a New Contraction Principle
por: Chen, Zijun, et al.
Publicado: (2026)

Deep Learning for Computing Convergence Rates of Markov Chains
por: Qu, Yanlin, et al.
Publicado: (2024)

Structural and Convergence Analysis of Discrete-Time Denoising Diffusion Probabilistic Models
por: Nakano, Yumiharu
Publicado: (2024)

Improved Finite-Particle Convergence Rates for Stein Variational Gradient Descent
por: Banerjee, Sayan, et al.
Publicado: (2024)

Simple Stepsize for Quasi-Newton Methods with Global Convergence Guarantees
por: Agafonov, Artem, et al.
Publicado: (2025)

A Generalization Result for Convergence in Learning-to-Optimize
por: Sucker, Michael, et al.
Publicado: (2024)

Convergence of Unadjusted Langevin in High Dimensions: Delocalization of Bias
por: Chen, Yifan, et al.
Publicado: (2024)

Constant Stepsize Q-learning: Distributional Convergence, Bias and Extrapolation
por: Zhang, Yixuan, et al.
Publicado: (2024)

On Convergence of Average-Reward Q-Learning in Weakly Communicating Markov Decision Processes
por: Wan, Yi, et al.
Publicado: (2024)

Steady-State Behavior of Constant-Stepsize Stochastic Approximation: Gaussian Approximation and Tail Bounds
por: Wang, Zedong, et al.
Publicado: (2026)

Convergence Analysis of Newton's Method for Neural Networks in the Overparameterized Limit
por: Riedl, Konstantin, et al.
Publicado: (2026)

Convergence rates for the Adam optimizer
por: Dereich, Steffen, et al.
Publicado: (2024)

Convergence, Sticking and Escape: Stochastic Dynamics Near Critical Points in SGD
por: Dudukalov, Dmitry, et al.
Publicado: (2025)

Pointwise Convergence for Random Ergodic Averages in Non-commutative $L^p$-spaces
por: Merdy, Christian Le, et al.
Publicado: (2026)

On Convergence of the Alternating Directions SGHMC Algorithm
por: Ghosh, Soumyadip, et al.
Publicado: (2024)

Convergence of Two Time-Scale Stochastic Approximation: A Martingale Approach
por: Vidyasagar, Mathukumalli
Publicado: (2026)

Convergence Analysis for General Probability Flow ODEs of Diffusion Models in Wasserstein Distances
por: Gao, Xuefeng, et al.
Publicado: (2024)

ResNets of All Shapes and Sizes: Convergence of Training Dynamics in the Large-scale Limit
por: Chaintron, Louis-Pierre, et al.
Publicado: (2026)

Finite-Time Bounds for Average-Reward Fitted Q-Iteration
por: Lee, Jongmin, et al.
Publicado: (2025)

Q-Learning under Finite Model Uncertainty
por: Sester, Julian, et al.
Publicado: (2024)

Prelimit Coupling and Steady-State Convergence of Constant-stepsize Nonsmooth Contractive SA
por: Zhang, Yixuan, et al.
Publicado: (2024)

Convergent Stochastic Training of Attention and Understanding LoRA
por: Sun, Zhengkai, et al.
Publicado: (2026)

Advancing Wasserstein Convergence Analysis of Score-Based Models: Insights from Discretization and Second-Order Acceleration
por: Yu, Yifeng, et al.
Publicado: (2025)

Lagrangian Index Policy for Restless Bandits with Average Reward
por: Avrachenkov, Konstantin, et al.
Publicado: (2024)

Convergence of Actor-Critic Learning for Mean Field Games and Mean Field Control in Continuous Spaces
por: Fouque, Jean-Pierre, et al.
Publicado: (2025)

Convergence of SGD for Training Neural Networks with Sliced Wasserstein Losses
por: Tanguy, Eloi
Publicado: (2023)

Weak Convergence Analysis of Online Neural Actor-Critic Algorithms
por: Lam, Samuel Chun-Hei, et al.
Publicado: (2024)

Controlling the Flow: Stability and Convergence for Stochastic Gradient Descent with Decaying Regularization
por: Kassing, Sebastian, et al.
Publicado: (2025)

Riemannian Langevin Dynamics: Strong Convergence of Geometric Euler-Maruyama Scheme
por: Zhan, Zhiyuan, et al.
Publicado: (2026)

Wasserstein Convergence of Score-based Generative Models under Semiconvexity and Discontinuous Gradients
por: Bruno, Stefano, et al.
Publicado: (2025)

Convergence Bounds for Sequential Monte Carlo on Multimodal Distributions using Soft Decomposition
por: Lee, Holden, et al.
Publicado: (2024)

Minimax Optimal Convergence of Gradient Descent in Logistic Regression via Large and Adaptive Stepsizes
por: Zhang, Ruiqi, et al.
Publicado: (2025)

Approximate Global Convergence of Independent Learning in Multi-Agent Systems
por: Jin, Ruiyang, et al.
Publicado: (2024)

Rates of Convergence in the Central Limit Theorem for Markov Chains, with an Application to TD Learning
por: Srikant, R.
Publicado: (2024)

Adaptive SGD with Line-Search and Polyak Stepsizes: Nonconvex Convergence and Accelerated Rates
por: Wu, Haotian
Publicado: (2025)