Copertina

Accelerated Policy Gradient: On the Convergence Rates of the Nesterov Momentum for Reinforcement Learning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Chen, Yen-Ju, Huang, Nai-Chieh, Lee, Ching-Pei, Hsieh, Ping-Chun
Natura:	Preprint
Pubblicazione:	2023
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Provable Accelerated Convergence of Nesterov's Momentum for Deep ReLU Neural Networks
di: Liao, Fangshuo, et al.
Pubblicazione: (2023)

PPO-Clip Attains Global Optimality: Towards Deeper Understandings of Clipping
di: Huang, Nai-Chieh, et al.
Pubblicazione: (2023)

SNOO: Step-K Nesterov Outer Optimizer - The Surprising Effectiveness of Nesterov Momentum Applied to Pseudo-Gradients
di: Kallusky, Dominik, et al.
Pubblicazione: (2025)

Momentum Streams for Optimizer-Inspired Transformers
di: Gai, Jingchu, et al.
Pubblicazione: (2026)

Fast Stochastic Policy Gradient: Negative Momentum for Reinforcement Learning
di: Zhang, Haobin, et al.
Pubblicazione: (2024)

EMA-Nesterov: Stabilizing Nesterov's Lookahead for Accelerated Deep Learning Optimization
di: Yau, Chung-Yiu, et al.
Pubblicazione: (2026)

Generalized Continuous-Time Models for Nesterov's Accelerated Gradient Methods
di: Park, Chanwoong, et al.
Pubblicazione: (2024)

Global Convergence of Natural Policy Gradient with Hessian-aided Momentum Variance Reduction
di: Feng, Jie, et al.
Pubblicazione: (2024)

Improving Infinitely Deep Bayesian Neural Networks with Nesterov's Accelerated Gradient Method
di: Yu, Chenxu, et al.
Pubblicazione: (2026)

Provable Acceleration of Nesterov's Accelerated Gradient for Rectangular Matrix Factorization and Linear Neural Networks
di: Xu, Zhenghao, et al.
Pubblicazione: (2024)

A Concise Lyapunov Analysis of Nesterov's Accelerated Gradient Method
di: Liu, Jun
Pubblicazione: (2025)

Leveraging Unlabeled Data Sharing through Kernel Function Approximation in Offline Reinforcement Learning
di: Lai, Yen-Ru, et al.
Pubblicazione: (2024)

Global Convergence of Wasserstein Policy Gradient for Entropy-Regularized Reinforcement Learning
di: Zhu, Zhaoyu, et al.
Pubblicazione: (2026)

Last-Iterate Global Convergence of Policy Gradients for Constrained Reinforcement Learning
di: Montenegro, Alessandro, et al.
Pubblicazione: (2024)

Self-Reinforced Graph Contrastive Learning
di: Hsieh, Chou-Ying, et al.
Pubblicazione: (2025)

Randomized Subspace Nesterov Accelerated Gradient
di: Omiya, Gaku, et al.
Pubblicazione: (2026)

Nesterov-Accelerated Robust Federated Learning Over Byzantine Adversaries
di: Xu, Lihan, et al.
Pubblicazione: (2025)

Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
di: Xie, Xingyu, et al.
Pubblicazione: (2022)

Quantum Hierarchical Reinforcement Learning via Variational Quantum Circuits
di: Lee, Yu-Ting, et al.
Pubblicazione: (2026)

On Global Convergence Rates for Federated Softmax Policy Gradient under Heterogeneous Environments
di: Labbi, Safwan, et al.
Pubblicazione: (2025)

Momentum-Based Federated Reinforcement Learning with Interaction and Communication Efficiency
di: Yue, Sheng, et al.
Pubblicazione: (2024)

Actor-Accelerated Policy Dual Averaging for Reinforcement Learning in Continuous Action Spaces
di: Gao, Ji, et al.
Pubblicazione: (2026)

Linear-Quadratic Mean-Field Reinforcement Learning: Convergence of Policy Gradient Methods
di: Carmona, René, et al.
Pubblicazione: (2019)

Convergence Rates of Constrained Expected Improvement
di: Wang, Haowei, et al.
Pubblicazione: (2025)

Muon with Nesterov Momentum: Heavy-Tailed Noise and (Randomized) Inexact Polar Decomposition
di: Choudhury, Sayantan, et al.
Pubblicazione: (2026)

Reusing Historical Trajectories in Natural Policy Gradient via Importance Sampling: Convergence and Convergence Rate
di: Lin, Yifan, et al.
Pubblicazione: (2024)

From Reward-Free Representations to Preferences: Rethinking Offline Preference-Based Reinforcement Learning
di: Yang, Jun-Jie, et al.
Pubblicazione: (2026)

Nesterov Acceleration for Ensemble Kalman Inversion and Variants
di: Vernon, Sydney, et al.
Pubblicazione: (2025)

Increasing Batch Size Improves Convergence of Stochastic Gradient Descent with Momentum
di: Kamo, Keisuke, et al.
Pubblicazione: (2025)

On the Convergence of Gradient Descent for Large Learning Rates
di: Crăciun, Alexandru, et al.
Pubblicazione: (2024)

Cross-Domain Policy Optimization via Bellman Consistency and Hybrid Critics
di: Chen, Ming-Hong, et al.
Pubblicazione: (2026)

A Reward-Free Viewpoint on Multi-Objective Reinforcement Learning
di: Chen, Ying-Tu, et al.
Pubblicazione: (2026)

Understanding Outer Optimizers in Local SGD: Learning Rates, Momentum, and Acceleration
di: Khaled, Ahmed, et al.
Pubblicazione: (2025)

On-Policy Policy Gradient Reinforcement Learning Without On-Policy Sampling
di: Corrado, Nicholas E., et al.
Pubblicazione: (2023)

Policy Gradient Methods for Risk-Sensitive Distributional Reinforcement Learning with Provable Convergence
di: Xiao, Minheng, et al.
Pubblicazione: (2024)

Provable Acceleration of Nesterov's Accelerated Gradient Method over Heavy Ball Method in Training Over-Parameterized Neural Networks
di: Liu, Xin, et al.
Pubblicazione: (2022)

Policy Gradient with Second Order Momentum
di: Sun, Tianyu
Pubblicazione: (2025)

Stochastic Resetting Accelerates Policy Convergence in Reinforcement Learning
di: Zhou, Jello, et al.
Pubblicazione: (2026)

On the Convergence Rate of LoRA Gradient Descent
di: Mu, Siqiao, et al.
Pubblicazione: (2025)

Inference of Online Newton Methods with Nesterov's Accelerated Sketching
di: Wang, Haoxuan, et al.
Pubblicazione: (2026)