Cover Image

Linear-Quadratic Mean-Field Reinforcement Learning: Convergence of Policy Gradient Methods

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Carmona, René, Laurière, Mathieu, Tan, Zongjun
Format:	Preprint
Published:	2019
Subjects:	Optimization and Control Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Convergence of Actor-Critic Learning for Mean Field Games and Mean Field Control in Continuous Spaces
by: Fouque, Jean-Pierre, et al.
Published: (2025)

Learning to Stop: Deep Learning for Mean Field Optimal Stopping
by: Magnino, Lorenzo, et al.
Published: (2024)

Reinforcement Learning for Finite Space Mean-Field Type Games
by: Shao, Kai, et al.
Published: (2024)

Population-Aware Imitation Learning in Mean-field Games with Common Noise
by: Lambrecht, Grégoire, et al.
Published: (2026)

Reconciling Discrete-Time Mixed Policies and Continuous-Time Relaxed Controls in Reinforcement Learning and Stochastic Control
by: Carmona, Rene, et al.
Published: (2025)

Analysis of Multiscale Reinforcement Q-Learning Algorithms for Mean Field Control Games
by: Angiuli, Andrea, et al.
Published: (2024)

How can the tragedy of the commons be prevented?: Introducing Linear Quadratic Mixed Mean Field Games
by: Dayanikli, Gokce, et al.
Published: (2024)

Recent Developments in Machine Learning Methods for Stochastic Control and Games
by: Hu, Ruimeng, et al.
Published: (2023)

Policy Gradient Converges to the Globally Optimal Policy for Nearly Linear-Quadratic Regulators
by: Han, Yinbin, et al.
Published: (2023)

An Efficient On-Policy Deep Learning Framework for Stochastic Optimal Control
by: Hua, Mengjian, et al.
Published: (2024)

Deep Learning for the Multiple Optimal Stopping Problem
by: Laurière, Mathieu, et al.
Published: (2025)

Solving Continuous Mean Field Games: Deep Reinforcement Learning for Non-Stationary Dynamics
by: Magnino, Lorenzo, et al.
Published: (2025)

Policy Gradient Methods for Discrete Time Linear Quadratic Regulator With Random Parameters
by: Li, Deyue
Published: (2023)

Deep Backward and Galerkin Methods for the Finite State Master Equation
by: Cohen, Asaf, et al.
Published: (2024)

Convergence of Multi-Scale Reinforcement Q-Learning Algorithms for Mean Field Game and Control Problems
by: Angiuli, Andrea, et al.
Published: (2023)

Bench-MFG: A Benchmark Suite for Learning in Stationary Mean Field Games
by: Magnino, Lorenzo, et al.
Published: (2026)

Policy Gradient Methods for Risk-Sensitive Distributional Reinforcement Learning with Provable Convergence
by: Xiao, Minheng, et al.
Published: (2024)

Linear Convergence of Entropy-Regularized Natural Policy Gradient with Linear Function Approximation
by: Cayci, Semih, et al.
Published: (2021)

Meta-Learning Linear Quadratic Regulators: A Policy Gradient MAML Approach for Model-free LQR
by: Toso, Leonardo F., et al.
Published: (2024)

Cooperation, Competition, and Common Pool Resources in Mean Field Games
by: Dayanikli, Gokce, et al.
Published: (2025)

Discrete-Time Mean Field Type Games: Probabilistic Setup
by: Lambrecht, Grégoire, et al.
Published: (2025)

A Deep Learning Method for Optimal Investment Under Relative Performance Criteria Among Heterogeneous Agents
by: Laurière, Mathieu, et al.
Published: (2024)

Fast Policy Learning for Linear Quadratic Control with Entropy Regularization
by: Guo, Xin, et al.
Published: (2023)

Beyond Stationarity: Convergence Analysis of Stochastic Softmax Policy Gradient Methods
by: Klein, Sara, et al.
Published: (2023)

An Overview of Some Extensions of Mean Field Games beyond Perfect Homogeneity and Anonymity
by: Laurière, Mathieu
Published: (2025)

Last-Iterate Convergent Policy Gradient Primal-Dual Methods for Constrained MDPs
by: Ding, Dongsheng, et al.
Published: (2023)

Sample Complexity of the Linear Quadratic Regulator: A Reinforcement Learning Lens
by: Moghaddam, Amirreza Neshaei, et al.
Published: (2024)

Learning in Mean Field Games: A Survey
by: Laurière, Mathieu, et al.
Published: (2022)

Natural Policy Gradient and Actor Critic Methods for Constrained Multi-Task Reinforcement Learning
by: Zeng, Sihan, et al.
Published: (2024)

Policy Iteration Reinforcement Learning Method for Continuous-Time Linear-Quadratic Mean-Field Control Problems
by: Li, Na, et al.
Published: (2023)

Reinforcement Learning for a Discrete-Time Linear-Quadratic Control Problem with an Application
by: Li, Lucky
Published: (2024)

Gradient Descent Converges Linearly to Flatter Minima than Gradient Flow in Shallow Linear Networks
by: Beneventano, Pierfrancesco, et al.
Published: (2025)

Fill-and-Spill: Deep Reinforcement Learning Policy Gradient Methods for Reservoir Operation Decision and Control
by: Tabas, Sadegh Sadeghi, et al.
Published: (2024)

Convergence Analysis for Learning Orthonormal Deep Linear Neural Networks
by: Qin, Zhen, et al.
Published: (2023)

On the Global Convergence of Risk-Averse Natural Policy Gradient Methods with Expected Conditional Risk Measures
by: Yu, Xian, et al.
Published: (2023)

Linear Convergence of Independent Natural Policy Gradient in Games with Entropy Regularization
by: Sun, Youbang, et al.
Published: (2024)

Global Convergence Guarantees for Federated Policy Gradient Methods with Adversaries
by: Ganesh, Swetha, et al.
Published: (2024)

On the Last-Iterate Convergence of Shuffling Gradient Methods
by: Liu, Zijian, et al.
Published: (2024)

On the Convergence of Adaptive Gradient Methods for Nonconvex Optimization
by: Zhou, Dongruo, et al.
Published: (2018)

Directional Smoothness and Gradient Methods: Convergence and Adaptivity
by: Mishkin, Aaron, et al.
Published: (2024)