Closing the Gap: Achieving Global Convergence (Last Iterate) of Actor-Critic under Markovian Sampling with Neural Network Parametrization
Fuente:
arXiv
Guardado en:
| Autores principales: | Gaur, Mudit, Bedi, Amrit Singh, Wang, Di, Aggarwal, Vaneet |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
On The Global Convergence Of Online RLHF With Neural Parametrization
por: Gaur, Mudit, et al.
Publicado: (2024)
por: Gaur, Mudit, et al.
Publicado: (2024)
On The Sample Complexity Bounds In Bilevel Reinforcement Learning
por: Gaur, Mudit, et al.
Publicado: (2025)
por: Gaur, Mudit, et al.
Publicado: (2025)
Improved Sample Complexity For Diffusion Model Training Without Empirical Risk Minimizer Access
por: Gaur, Mudit, et al.
Publicado: (2025)
por: Gaur, Mudit, et al.
Publicado: (2025)
Generative Modeling with Continuous Flows: Sample Complexity of Flow Matching
por: Gaur, Mudit, et al.
Publicado: (2025)
por: Gaur, Mudit, et al.
Publicado: (2025)
Achieving Zero Constraint Violation for Constrained Reinforcement Learning via Conservative Natural Policy Gradient Primal-Dual Algorithm
por: Bai, Qinbo, et al.
Publicado: (2022)
por: Bai, Qinbo, et al.
Publicado: (2022)
Discrete State Diffusion Models: A Sample Complexity Perspective
por: Srikanth, Aadithya, et al.
Publicado: (2025)
por: Srikanth, Aadithya, et al.
Publicado: (2025)
Order-Optimal Sample Complexity of Rectified Flows
por: Sahoo, Hari Krishna, et al.
Publicado: (2026)
por: Sahoo, Hari Krishna, et al.
Publicado: (2026)
Last-Iterate Convergence of General Parameterized Policies in Constrained MDPs
por: Mondal, Washim Uddin, et al.
Publicado: (2024)
por: Mondal, Washim Uddin, et al.
Publicado: (2024)
Global Convergence for Average Reward Constrained MDPs with Primal-Dual Actor Critic Algorithm
por: Xu, Yang, et al.
Publicado: (2025)
por: Xu, Yang, et al.
Publicado: (2025)
Efficient $Q$-Learning and Actor-Critic Methods for Robust Average Reward Reinforcement Learning
por: Xu, Yang, et al.
Publicado: (2025)
por: Xu, Yang, et al.
Publicado: (2025)
BalancedDPO: Adaptive Multi-Metric Alignment
por: Tamboli, Dipesh, et al.
Publicado: (2025)
por: Tamboli, Dipesh, et al.
Publicado: (2025)
Align-Pro: A Principled Approach to Prompt Optimization for LLM Alignment
por: Trivedi, Prashant, et al.
Publicado: (2025)
por: Trivedi, Prashant, et al.
Publicado: (2025)
Sample Complexity Analysis for Constrained Bilevel Reinforcement Learning
por: Saxena, Naman, et al.
Publicado: (2026)
por: Saxena, Naman, et al.
Publicado: (2026)
Learning Multi-Robot Coordination through Locality-Based Factorized Multi-Agent Actor-Critic Algorithm
por: Shek, Chak Lam, et al.
Publicado: (2025)
por: Shek, Chak Lam, et al.
Publicado: (2025)
Global Convergence Guarantees for Federated Policy Gradient Methods with Adversaries
por: Ganesh, Swetha, et al.
Publicado: (2024)
por: Ganesh, Swetha, et al.
Publicado: (2024)
Actor-Critics Can Achieve Optimal Sample Efficiency
por: Tan, Kevin, et al.
Publicado: (2025)
por: Tan, Kevin, et al.
Publicado: (2025)
Sample-Efficient Constrained Reinforcement Learning with General Parameterization
por: Mondal, Washim Uddin, et al.
Publicado: (2024)
por: Mondal, Washim Uddin, et al.
Publicado: (2024)
LANTERN: LLM-Augmented Neurosymbolic Transfer with Experience-Gated Reasoning Networks
por: Alinejad, Mahyar, et al.
Publicado: (2026)
por: Alinejad, Mahyar, et al.
Publicado: (2026)
Oracle-Robust Online Alignment for Large Language Models
por: Li, Zimeng, et al.
Publicado: (2026)
por: Li, Zimeng, et al.
Publicado: (2026)
Improved Sample Complexity Analysis of Natural Policy Gradient Algorithm with General Parameterization for Infinite Horizon Discounted Reward Markov Decision Processes
por: Mondal, Washim Uddin, et al.
Publicado: (2023)
por: Mondal, Washim Uddin, et al.
Publicado: (2023)
AI Cap-and-Trade: Efficiency Incentives for Accessibility and Sustainability
por: Bornstein, Marco, et al.
Publicado: (2026)
por: Bornstein, Marco, et al.
Publicado: (2026)
On the Global Optimality of Policy Gradient Methods in General Utility Reinforcement Learning
por: Barakat, Anas, et al.
Publicado: (2024)
por: Barakat, Anas, et al.
Publicado: (2024)
A Technical Survey of Reinforcement Learning Techniques for Large Language Models
por: Srivastava, Saksham Sahai, et al.
Publicado: (2025)
por: Srivastava, Saksham Sahai, et al.
Publicado: (2025)
Don't Freeze, Don't Crash: Extending the Safe Operating Range of Neural Navigation in Dense Crowds
por: Zhang, Jiefu, et al.
Publicado: (2026)
por: Zhang, Jiefu, et al.
Publicado: (2026)
A Scalable Quantum Non-local Neural Network for Image Classification
por: Gupta, Sparsh, et al.
Publicado: (2024)
por: Gupta, Sparsh, et al.
Publicado: (2024)
A Sharper Global Convergence Analysis for Average Reward Reinforcement Learning via an Actor-Critic Approach
por: Ganesh, Swetha, et al.
Publicado: (2024)
por: Ganesh, Swetha, et al.
Publicado: (2024)
Network Diffuser for Placing-Scheduling Service Function Chains with Inverse Demonstration
por: Zhang, Zuyuan, et al.
Publicado: (2025)
por: Zhang, Zuyuan, et al.
Publicado: (2025)
Why Pass@k Optimization Can Degrade Pass@1: Prompt Interference in LLM Post-training
por: Barakat, Anas, et al.
Publicado: (2026)
por: Barakat, Anas, et al.
Publicado: (2026)
ECPv2: Fast, Efficient, and Scalable Global Optimization of Lipschitz Functions
por: Fourati, Fares, et al.
Publicado: (2025)
por: Fourati, Fares, et al.
Publicado: (2025)
Stronger Approximation Guarantees for Non-Monotone γ-Weakly DR-Submodular Maximization
por: Jadav, Hareshkumar, et al.
Publicado: (2026)
por: Jadav, Hareshkumar, et al.
Publicado: (2026)
$γ$-weakly $θ$-up-concavity: A Unified Framework for Non-Convex Optimization Beyond DR-Submodular and OSS Functions
por: Pedramfar, Mohammad, et al.
Publicado: (2026)
por: Pedramfar, Mohammad, et al.
Publicado: (2026)
Accelerating Quantum Reinforcement Learning with a Quantum Natural Policy Gradient Based Approach
por: Xu, Yang, et al.
Publicado: (2025)
por: Xu, Yang, et al.
Publicado: (2025)
Improved Bayesian Regret Bounds for Thompson Sampling in Reinforcement Learning
por: Moradipari, Ahmadreza, et al.
Publicado: (2023)
por: Moradipari, Ahmadreza, et al.
Publicado: (2023)
Stochastic Submodular Bandits with Delayed Composite Anonymous Bandit Feedback
por: Pedramfar, Mohammad, et al.
Publicado: (2023)
por: Pedramfar, Mohammad, et al.
Publicado: (2023)
Draft-Conditioned Constrained Decoding for Structured Generation in LLMs
por: Reddy, Avinash, et al.
Publicado: (2026)
por: Reddy, Avinash, et al.
Publicado: (2026)
Beyond Text: Utilizing Vocal Cues to Improve Decision Making in LLMs for Robot Navigation Tasks
por: Sun, Xingpeng, et al.
Publicado: (2024)
por: Sun, Xingpeng, et al.
Publicado: (2024)
Global Convergence and Rich Feature Learning in $L$-Layer Infinite-Width Neural Networks under $μ$P Parametrization
por: Chen, Zixiang, et al.
Publicado: (2025)
por: Chen, Zixiang, et al.
Publicado: (2025)
Variational Offline Multi-agent Skill Discovery
por: Chen, Jiayu, et al.
Publicado: (2024)
por: Chen, Jiayu, et al.
Publicado: (2024)
A Bi-directional Quantum Search Algorithm
por: Konar, Debanjan, et al.
Publicado: (2024)
por: Konar, Debanjan, et al.
Publicado: (2024)
Finite-time Convergence Analysis of Actor-Critic with Evolving Reward
por: Hu, Rui, et al.
Publicado: (2025)
por: Hu, Rui, et al.
Publicado: (2025)
Ejemplares similares
-
On The Global Convergence Of Online RLHF With Neural Parametrization
por: Gaur, Mudit, et al.
Publicado: (2024) -
On The Sample Complexity Bounds In Bilevel Reinforcement Learning
por: Gaur, Mudit, et al.
Publicado: (2025) -
Improved Sample Complexity For Diffusion Model Training Without Empirical Risk Minimizer Access
por: Gaur, Mudit, et al.
Publicado: (2025) -
Generative Modeling with Continuous Flows: Sample Complexity of Flow Matching
por: Gaur, Mudit, et al.
Publicado: (2025) -
Achieving Zero Constraint Violation for Constrained Reinforcement Learning via Conservative Natural Policy Gradient Primal-Dual Algorithm
por: Bai, Qinbo, et al.
Publicado: (2022)