Copertina

CoPRIS: Efficient and Stable Reinforcement Learning via Concurrency-Controlled Partial Rollout with Importance Sampling

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Qu, Zekai, Pan, Yinxu, Sun, Ao, Xiao, Chaojun, Han, Xu
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Not All Rollouts are Useful: Down-Sampling Rollouts in LLM Reinforcement Learning
di: Xu, Yixuan Even, et al.
Pubblicazione: (2025)

APRIL: Active Partial Rollouts in Reinforcement Learning to Tame Long-tail Generation
di: Zhou, Yuzhen, et al.
Pubblicazione: (2025)

Partial Domain Adaptation via Importance Sampling-based Shift Correction
di: Guo, Cheng-Jun, et al.
Pubblicazione: (2025)

EchoRL: Reinforcement Learning via Rollout Echoing
di: Bi, Jinhe, et al.
Pubblicazione: (2026)

Sparse-RL: Breaking the Memory Wall in LLM Reinforcement Learning via Stable Sparse Rollouts
di: Luo, Sijia, et al.
Pubblicazione: (2026)

Guided Cooperation in Hierarchical Reinforcement Learning via Model-based Rollout
di: Wang, Haoran, et al.
Pubblicazione: (2023)

RoRecomp: Enhancing Reasoning Efficiency via Rollout Response Recomposition in Reinforcement Learning
di: Li, Gang, et al.
Pubblicazione: (2025)

Train Less, Learn More: Adaptive Efficient Rollout Optimization for Group-Based Reinforcement Learning
di: Zhang, Zhi, et al.
Pubblicazione: (2026)

Act Only When It Pays: Efficient Reinforcement Learning for LLM Reasoning via Selective Rollouts
di: Zheng, Haizhong, et al.
Pubblicazione: (2025)

Portfolio Reinforcement Learning with Scenario-Context Rollout
di: Bendatu, Vanya Priscillia, et al.
Pubblicazione: (2026)

SPEC-RL: Accelerating On-Policy Reinforcement Learning with Speculative Rollouts
di: Liu, Bingshuai, et al.
Pubblicazione: (2025)

FP4 Explore, BF16 Train: Diffusion Reinforcement Learning via Efficient Rollout Scaling
di: Li, Yitong, et al.
Pubblicazione: (2026)

Superior Computer Chess with Model Predictive Control, Reinforcement Learning, and Rollout
di: Gundawar, Atharva, et al.
Pubblicazione: (2024)

More Efficient Randomized Exploration for Reinforcement Learning via Approximate Sampling
di: Ishfaq, Haque, et al.
Pubblicazione: (2024)

Stable and Efficient Single-Rollout RL for Multimodal Reasoning
di: Liu, Rui, et al.
Pubblicazione: (2025)

Contextual Rollout Bandits for Reinforcement Learning with Verifiable Rewards
di: Lu, Xiaodong, et al.
Pubblicazione: (2026)

SrSv: Integrating Sequential Rollouts with Sequential Value Estimation for Multi-agent Reinforcement Learning
di: Wan, Xu, et al.
Pubblicazione: (2025)

KARL: Mitigating Hallucinations in LLMs via Knowledge-Boundary-Aware Reinforcement Learning
di: Gao, Cheng, et al.
Pubblicazione: (2026)

Provable Representation with Efficient Planning for Partial Observable Reinforcement Learning
di: Zhang, Hongming, et al.
Pubblicazione: (2023)

Nested-ReFT: Efficient Reinforcement Learning for Large Language Model Fine-Tuning via Off-Policy Rollouts
di: Heuillet, Maxime, et al.
Pubblicazione: (2025)

CuSearch: Curriculum Rollout Sampling via Search Depth for Agentic RAG
di: Shen, Jianghan, et al.
Pubblicazione: (2026)

Reinforcement Learning for Control with Probabilistic Stability Guarantee: A Finite-Sample Approach
di: Han, Minghao, et al.
Pubblicazione: (2026)

Adaptive Rollout Allocation for Online Reinforcement Learning with Verifiable Rewards
di: Nguyen, Hieu Trung, et al.
Pubblicazione: (2026)

PyBench: Evaluating LLM Agent on various real-world coding tasks
di: Zhang, Yaolun, et al.
Pubblicazione: (2024)

BQSched: A Non-intrusive Scheduler for Batch Concurrent Queries via Reinforcement Learning
di: Xu, Chenhao, et al.
Pubblicazione: (2025)

The Elephant in the Room: Rethinking the Usage of Pre-trained Language Model in Sequential Recommendation
di: Qu, Zekai, et al.
Pubblicazione: (2024)

InfLLM: Training-Free Long-Context Extrapolation for LLMs with an Efficient Context Memory
di: Xiao, Chaojun, et al.
Pubblicazione: (2024)

Improving Execution Concurrency in Partial-Order Plans via Block-Substitution
di: Noor, Sabah Binte, et al.
Pubblicazione: (2024)

Embedding Domain Knowledge for Large Language Models via Reinforcement Learning from Augmented Generation
di: Nie, Chaojun, et al.
Pubblicazione: (2025)

LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning
di: Pan, Rui, et al.
Pubblicazione: (2024)

BubbleSpec: Turning Long-Tail Bubbles into Speculative Rollout Drafts for Synchronous Reinforcement Learning
di: Xu, Yuhang, et al.
Pubblicazione: (2026)

Relative Importance Sampling for off-Policy Actor-Critic in Deep Reinforcement Learning
di: Humayoo, Mahammad, et al.
Pubblicazione: (2018)

Learning Rollout from Sampling:An R1-Style Tokenized Traffic Simulation Model
di: Wang, Ziyan, et al.
Pubblicazione: (2026)

APB-V: Accelerating Long-Video Understanding via Sequence-Parallelism-aware Approximate Attention
di: Huang, Yuxiang, et al.
Pubblicazione: (2026)

Multiple Unmanned Aerial Vehicle Formation Control through Deep Reinforcement Learning with Offline Sample Correction
di: Zhongkai Chen, et al.
Pubblicazione: (2025)

RTMC: Step-Level Credit Assignment via Rollout Trees
di: Wang, Tao, et al.
Pubblicazione: (2026)

Knowledgeable Agents by Offline Reinforcement Learning from Large Language Model Rollouts
di: Pang, Jing-Cheng, et al.
Pubblicazione: (2024)

Stable Reinforcement Learning for Efficient Reasoning
di: Dai, Muzhi, et al.
Pubblicazione: (2025)

DARTS: Distribution-Aware Active Rollout Trajectory Shaping for Accelerating LLM Reinforcement Learning
di: Wang, Yujie, et al.
Pubblicazione: (2026)

SceneDiffuser: Efficient and Controllable Driving Simulation Initialization and Rollout
di: Jiang, Chiyu Max, et al.
Pubblicazione: (2024)