Copertina

POPE: Learning to Reason on Hard Problems via Privileged On-Policy Exploration

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Qu, Yuxiao, Setlur, Amrith, Smith, Virginia, Salakhutdinov, Ruslan, Kumar, Aviral
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Artificial Intelligence Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

RLAD: Training LLMs to Discover Abstractions for Solving Reasoning Problems
di: Qu, Yuxiao, et al.
Pubblicazione: (2025)

Optimizing Test-Time Compute via Meta Reinforcement Fine-Tuning
di: Qu, Yuxiao, et al.
Pubblicazione: (2025)

QED-Nano: Teaching a Tiny Model to Prove Hard Theorems
di: LM-Provers, et al.
Pubblicazione: (2026)

Reuse your FLOPs: Scaling RL on Hard Problems by Conditioning on Very Off-Policy Prefixes
di: Setlur, Amrith, et al.
Pubblicazione: (2026)

InT: Self-Proposed Interventions Enable Credit Assignment in LLM Reasoning
di: Yang, Matthew Y. R., et al.
Pubblicazione: (2026)

RL on Incorrect Synthetic Data Scales the Efficiency of LLM Math Reasoning by Eight-Fold
di: Setlur, Amrith, et al.
Pubblicazione: (2024)

Reasoning Cache: Continual Improvement Over Long Horizons via Short-Horizon RL
di: Wu, Ian, et al.
Pubblicazione: (2026)

Recursive Introspection: Teaching Language Model Agents How to Self-Improve
di: Qu, Yuxiao, et al.
Pubblicazione: (2024)

Scaling Test-Time Compute Without Verification or RL is Suboptimal
di: Setlur, Amrith, et al.
Pubblicazione: (2025)

IsoCompute Playbook: Optimally Scaling Sampling Compute for LLM RL
di: Cheng, Zhoujun, et al.
Pubblicazione: (2026)

CaRT: Teaching LLM Agents to Know When They Know Enough
di: Liu, Grace, et al.
Pubblicazione: (2025)

Cog-DRIFT: Exploration on Adaptively Reformulated Instances Enables Learning from Hard Reasoning Problems
di: Chen, Justin Chih-Yao, et al.
Pubblicazione: (2026)

e3: Learning to Explore Enables Extrapolation of Test-Time Compute for LLMs
di: Setlur, Amrith, et al.
Pubblicazione: (2025)

Tree Search for Language Model Agents
di: Koh, Jing Yu, et al.
Pubblicazione: (2024)

TRIM: Hybrid Inference via Targeted Stepwise Routing in Multi-Step Reasoning Tasks
di: Kapoor, Vansh, et al.
Pubblicazione: (2026)

Verifier-Backed Hard Problem Generation for Mathematical Reasoning
di: Lai, Yuhang, et al.
Pubblicazione: (2026)

Rewarding Progress: Scaling Automated Process Verifiers for LLM Reasoning
di: Setlur, Amrith, et al.
Pubblicazione: (2024)

Learning to Reason under Off-Policy Guidance
di: Yan, Jianhao, et al.
Pubblicazione: (2025)

Unlocking Reasoning Capabilities in LLMs via Reinforcement Learning Exploration
di: Deng, Wenhao, et al.
Pubblicazione: (2025)

ArCHer: Training Language Model Agents via Hierarchical Multi-Turn RL
di: Zhou, Yifei, et al.
Pubblicazione: (2024)

RLAC: Reinforcement Learning with Adversarial Critic for Free-Form Generation Tasks
di: Wu, Mian, et al.
Pubblicazione: (2025)

Training a Generally Curious Agent
di: Tajwar, Fahim, et al.
Pubblicazione: (2025)

NPG-Muse: Scaling Long Chain-of-Thought Reasoning with NP-Hard Graph Problems
di: Wang, Yuyao, et al.
Pubblicazione: (2025)

Learning Using Generated Privileged Information by Text-to-Image Diffusion Models
di: Menadil, Rafael-Edy, et al.
Pubblicazione: (2023)

Multimodal Tabular Reasoning with Privileged Structured Information
di: Jiang, Jun-Peng, et al.
Pubblicazione: (2025)

Thinking vs. Doing: Agents that Reason by Scaling Test-Time Interaction
di: Shen, Junhong, et al.
Pubblicazione: (2025)

RePOPE: Impact of Annotation Errors on the POPE Benchmark
di: Neuhaus, Yannic, et al.
Pubblicazione: (2025)

Curriculum Reinforcement Learning from Easy to Hard Tasks Improves LLM Reasoning
di: Parashar, Shubham, et al.
Pubblicazione: (2025)

Unfamiliar Finetuning Examples Control How Language Models Hallucinate
di: Kang, Katie, et al.
Pubblicazione: (2024)

Beyond Markovian: Reflective Exploration via Bayes-Adaptive RL for LLM Reasoning
di: Zhang, Shenao, et al.
Pubblicazione: (2025)

Slow-Fast Policy Optimization: Reposition-Before-Update for LLM Reasoning
di: Wang, Ziyan, et al.
Pubblicazione: (2025)

Reasoning through Exploration: A Reinforcement Learning Framework for Robust Function Calling
di: Hao, Bingguang, et al.
Pubblicazione: (2025)

Dual-Uncertainty Guided Policy Learning for Multimodal Reasoning
di: Liu, Rui, et al.
Pubblicazione: (2025)

Klear-Reasoner: Advancing Reasoning Capability via Gradient-Preserving Clipping Policy Optimization
di: Su, Zhenpeng, et al.
Pubblicazione: (2025)

Optimizing Anytime Reasoning via Budget Relative Policy Optimization
di: Qi, Penghui, et al.
Pubblicazione: (2025)

Offline RL for Adaptive Policy Retrieval in Prior Authorization
di: Sharifullin, Ruslan, et al.
Pubblicazione: (2026)

SmartSwitch: Advancing LLM Reasoning by Overcoming Underthinking via Promoting Deeper Thought Exploration
di: Zhang, Xichen, et al.
Pubblicazione: (2025)

Pass@K Policy Optimization: Solving Harder Reinforcement Learning Problems
di: Walder, Christian, et al.
Pubblicazione: (2025)

HTPO: Towards Exploration-Exploitation Balanced Policy Optimization via Hierarchical Token-level Objective Control
di: Yao, Xincheng, et al.
Pubblicazione: (2026)

Training Reasoning Models on Saturated Problems via Failure-Prefix Conditioning
di: Kim, Minwu, et al.
Pubblicazione: (2026)