Cover Image

Efficient Process Reward Model Training via Active Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Duan, Keyu, Liu, Zichen, Mao, Xin, Pang, Tianyu, Chen, Changyu, Chen, Qiguang, Shieh, Michael Qizhe, Dou, Longxu
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Training Optimal Large Diffusion Language Models
by: Ni, Jinjie, et al.
Published: (2025)

Unnatural Languages Are Not Bugs but Features for LLMs
by: Duan, Keyu, et al.
Published: (2025)

In-Context Reinforcement Learning for Tool Use in Large Language Models
by: Ye, Yaoqi, et al.
Published: (2026)

Diffusion Language Models are Super Data Learners
by: Ni, Jinjie, et al.
Published: (2025)

NoisyRollout: Reinforcing Visual Reasoning with Data Augmentation
by: Liu, Xiangyan, et al.
Published: (2025)

LongRLVR: Long-Context Reinforcement Learning Requires Verifiable Context Rewards
by: Chen, Guanzheng, et al.
Published: (2026)

ImageEdit-R1: Boosting Multi-Agent Image Editing via Reinforcement Learning
by: Zhao, Yiran, et al.
Published: (2026)

Language Models Can Learn from Verbal Feedback Without Scalar Rewards
by: Luo, Renjie, et al.
Published: (2025)

Understanding R1-Zero-Like Training: A Critical Perspective
by: Liu, Zichen, et al.
Published: (2025)

Bootstrapping Language Models with DPO Implicit Rewards
by: Chen, Changyu, et al.
Published: (2024)

RegMix: Data Mixture as Regression for Language Model Pre-training
by: Liu, Qian, et al.
Published: (2024)

Prototypical Reward Network for Data-Efficient RLHF
by: Zhang, Jinghan, et al.
Published: (2024)

Sample-Efficient Alignment for LLMs
by: Liu, Zichen, et al.
Published: (2024)

LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
by: Chen, Guanzheng, et al.
Published: (2025)

Parameter-Efficient Fine-Tuning With Adapters
by: Chen, Keyu, et al.
Published: (2024)

Reasoning Does Not Necessarily Improve Role-Playing Ability
by: Feng, Xiachong, et al.
Published: (2025)

FlowReasoner: Reinforcing Query-Level Meta-Agents
by: Gao, Hongcheng, et al.
Published: (2025)

Defeating the Training-Inference Mismatch via FP16
by: Qi, Penghui, et al.
Published: (2025)

SynthRL: Scaling Visual Reasoning with Verifiable Data Synthesis
by: Wu, Zijian, et al.
Published: (2025)

Adversarial Training for Process Reward Models
by: Juneja, Gurusha, et al.
Published: (2025)

Your Agent, Their Asset: A Real-World Safety Analysis of OpenClaw
by: Wang, Zijun, et al.
Published: (2026)

Efficient Reasoning via Reward Model
by: Wang, Yuhao, et al.
Published: (2025)

DLPO: Towards a Robust, Efficient, and Generalizable Prompt Optimization Framework from a Deep-Learning Perspective
by: Peng, Dengyun, et al.
Published: (2025)

The Emergence of Abstract Thought in Large Language Models Beyond Any Language
by: Chen, Yuxin, et al.
Published: (2025)

RAPID: Long-Context Inference with Retrieval-Augmented Speculative Decoding
by: Chen, Guanzheng, et al.
Published: (2025)

Improving Autoregressive Image Generation through Coarse-to-Fine Token Prediction
by: Guo, Ziyao, et al.
Published: (2025)

Entropy-Guided Data-Efficient Training for Multimodal Reasoning Reward Models
by: Yang, Shidong, et al.
Published: (2026)

Sailor: Open Language Models for South-East Asia
by: Dou, Longxu, et al.
Published: (2024)

Optimizing Anytime Reasoning via Budget Relative Policy Optimization
by: Qi, Penghui, et al.
Published: (2025)

Efficient Process Reward Modeling via Contrastive Mutual Information
by: Lee, Nakyung, et al.
Published: (2026)

SmartSearch: Process Reward-Guided Query Refinement for Search Agents
by: Wen, Tongyu, et al.
Published: (2026)

Process-based Self-Rewarding Language Models
by: Zhang, Shimao, et al.
Published: (2025)

GEM: A Gym for Agentic LLMs
by: Liu, Zichen, et al.
Published: (2025)

Joint Reward Modeling: Internalizing Chain-of-Thought for Efficient Visual Reward Models
by: Yang, Yankai, et al.
Published: (2026)

An Efficient and Precise Training Data Construction Framework for Process-supervised Reward Model in Mathematical Reasoning
by: Sun, Wei, et al.
Published: (2025)

DT2IT-MRM: Debiased Preference Construction and Iterative Training for Multimodal Reward Modeling
by: Zhang, Zhihong, et al.
Published: (2026)

FlashVID: Efficient Video Large Language Models via Training-free Tree-based Spatiotemporal Token Merging
by: Fan, Ziyang, et al.
Published: (2026)

PRISM: Pushing the Frontier of Deep Think via Process Reward Model-Guided Inference
by: Sharma, Rituraj, et al.
Published: (2026)

Scaling Autonomous Agents via Automatic Reward Modeling And Planning
by: Chen, Zhenfang, et al.
Published: (2025)

Unlocking Large Language Model's Planning Capabilities with Maximum Diversity Fine-tuning
by: Li, Wenjun, et al.
Published: (2024)