Cover Image

Generate, Filter, Control, Replay: A Comprehensive Survey of Rollout Strategies for LLM Reinforcement Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Surana, Rohan, Mundada, Gagan, Jiang, Xunyi, Wang, Chuhan, Tang, Zhenwei, Jiao, Difan, Huang, Zihan, Xiong, Yuxin, Wu, Junda, Yu, Sheldon, Li, Xintong, Jain, Raghav, Kuang, Nikki, Zhou, Sizhe, Jin, Bowen, Chu, Zhendong, Yu, Tong, Rossi, Ryan, Huang, Kuan-Hao, Shang, Jingbo, Han, Jiawei, McAuley, Julian
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

WS-GRPO: Weakly-Supervised Group-Relative Policy Optimization for Rollout-Efficient Reasoning
by: Mundada, Gagan, et al.
Published: (2026)

Importance Sampling for Multi-Negative Multimodal Direct Preference Optimization
by: Li, Xintong, et al.
Published: (2025)

Skill-R1: Agent Skill Evolution via Reinforcement Learning
by: Vishe, Yash, et al.
Published: (2026)

F-GRPO: Factorized Group-Relative Policy Optimization for Unified Candidate Generation and Ranking
by: Surana, Rohan, et al.
Published: (2026)

AMPS: Adaptive Modality Preference Steering via Functional Entropy
by: Huang, Zihan, et al.
Published: (2026)

OLIVIA: Online Learning via Inference-time Action Adaptation for Decision Making in LLM ReAct Agents
by: Yu, Sheldon, et al.
Published: (2026)

MusiCRS: Benchmarking Audio-Centric Conversational Recommendation
by: Surana, Rohan, et al.
Published: (2025)

MASS-DPO: Multi-negative Active Sample Selection for Direct Policy Optimization
by: Surana, Rohan, et al.
Published: (2026)

Evaluation on Entity Matching in Recommender Systems
by: Huang, Zihan, et al.
Published: (2026)

SceneAlign: Aligning Multimodal Reasoning to Scene Graphs in Complex Visual Scenes
by: Wang, Chuhan, et al.
Published: (2026)

WildScore: Benchmarking MLLMs in-the-Wild Symbolic Music Reasoning
by: Mundada, Gagan, et al.
Published: (2025)

Explainable Chain-of-Thought Reasoning: An Empirical Analysis on State-Aware Reasoning Dynamics
by: Yu, Sheldon, et al.
Published: (2025)

Skill-CMIB: Multimodal Agent Skill for Consistent Action via Conditional Multimodal Information Bottleneck
by: Huang, Zihan, et al.
Published: (2026)

Composer Vector: Style-steering Symbolic Music Generation in a Latent Space
by: Jiang, Xunyi, et al.
Published: (2026)

Active Learning for Direct Preference Optimization
by: Kveton, Branislav, et al.
Published: (2025)

CTRLS: Chain-of-Thought Reasoning via Latent State-Transition
by: Wu, Junda, et al.
Published: (2025)

From Reviews to Dialogues: Active Synthesis for Zero-Shot LLM-based Conversational Recommender System
by: Surana, Rohan, et al.
Published: (2025)

When Benchmarks Age: Temporal Misalignment through Large Language Model Factuality Evaluation
by: Jiang, Xunyi, et al.
Published: (2025)

In-context Ranking Preference Optimization
by: Wu, Junda, et al.
Published: (2025)

CoMMIT: Coordinated Multimodal Instruction Tuning
by: Li, Xintong, et al.
Published: (2024)

CSyMR: Benchmarking Compositional Music Information Retrieval in Symbolic Music Reasoning
by: Wang, Boyang, et al.
Published: (2025)

MuseCPBench: an Empirical Study of Music Editing Methods through Music Context Preservation
by: Vishe, Yash, et al.
Published: (2025)

Listwise Preference Diffusion Optimization for User Behavior Trajectories Prediction
by: Huang, Hongtao, et al.
Published: (2025)

A Low-Latency Fraud Detection Layer for Detecting Adversarial Interaction Patterns in LLM-Powered Agents
by: Yu, Sheldon, et al.
Published: (2026)

Mitigating Visual Knowledge Forgetting in MLLM Instruction-tuning via Modality-decoupled Gradient Descent
by: Wu, Junda, et al.
Published: (2025)

Multi-Behavior Generative Recommendation
by: Liu, Zihan, et al.
Published: (2024)

OCEAN: Offline Chain-of-thought Evaluation and Alignment in Large Language Models
by: Wu, Junda, et al.
Published: (2024)

Three central limit theorems for the unbounded excursion component of a Gaussian field
by: McAuley, Michael
Published: (2024)

Children in Custody
by: McAuley, Mary
Published: (2022)

Politics and the Soviet Union / Mary McAuley
by: McAuley, Mary

Limit theorems for non-local functionals of smooth Gaussian fields via quasi-association
by: McAuley, Michael
Published: (2026)

Weakly-supervised VLM-guided Partial Contrastive Learning for Visual Language Navigation
by: Wang, Ruoyu, et al.
Published: (2025)

A Survey on Personalized and Pluralistic Preference Alignment in Large Language Models
by: Xie, Zhouhang, et al.
Published: (2025)

Self-Updatable Large Language Models by Integrating Context into Model Parameters
by: Wang, Yu, et al.
Published: (2024)

Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions
by: Hu, Yuanzhe, et al.
Published: (2025)

Pluralistic Off-policy Evaluation and Alignment
by: Huang, Chengkai, et al.
Published: (2025)

DICE: Dynamic In-Context Example Selection in LLM Agents via Efficient Knowledge Transfer
by: Wang, Ruoyu, et al.
Published: (2025)

Knowledge-Aware Query Expansion with Large Language Models for Textual and Relational Retrieval
by: Xia, Yu, et al.
Published: (2024)

Improving Data Efficiency for LLM Reinforcement Fine-tuning Through Difficulty-targeted Online Data Selection and Rollout Replay
by: Sun, Yifan, et al.
Published: (2025)

Reddit2Deezer: A Scalable Dataset for Real-World Grounded Conversational Music Recommendation
by: Kim, Haven, et al.
Published: (2026)