Imagen de Portada

RewardBench: Evaluating Reward Models for Language Modeling

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Lambert, Nathan, Pyatkin, Valentina, Morrison, Jacob, Miranda, LJ, Lin, Bill Yuchen, Chandu, Khyathi, Dziri, Nouha, Kumar, Sachin, Zick, Tom, Choi, Yejin, Smith, Noah A., Hajishirzi, Hannaneh
Formato:	Preprint
Publicado:	2024
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

RewardBench 2: Advancing Reward Model Evaluation
por: Malik, Saumya, et al.
Publicado: (2025)

TurnWise: The Gap between Single- and Multi-turn Language Model Capabilities
por: Graf, Victoria, et al.
Publicado: (2026)

WildBench: Benchmarking LLMs with Challenging Tasks from Real Users in the Wild
por: Lin, Bill Yuchen, et al.
Publicado: (2024)

The Art of Saying No: Contextual Noncompliance in Language Models
por: Brahman, Faeze, et al.
Publicado: (2024)

M-RewardBench: Evaluating Reward Models in Multilingual Settings
por: Gureja, Srishti, et al.
Publicado: (2024)

VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Models
por: Li, Lei, et al.
Publicado: (2024)

CMI-RewardBench: Evaluating Music Reward Models with Compositional Multimodal Instruction
por: Ma, Yinghao, et al.
Publicado: (2026)

Personalized RewardBench: Evaluating Reward Models with Human Aligned Personalization
por: Ma, Qiyao, et al.
Publicado: (2026)

Multimodal RewardBench: Holistic Evaluation of Reward Models for Vision Language Models
por: Yasunaga, Michihiro, et al.
Publicado: (2025)

Long-form RewardBench: Evaluating Reward Models for Long-form Generation
por: Huang, Hui, et al.
Publicado: (2026)

Unpacking DPO and PPO: Disentangling Best Practices for Learning from Preference Feedback
por: Ivison, Hamish, et al.
Publicado: (2024)

IF-RewardBench: Benchmarking Judge Models for Instruction-Following Evaluation
por: Wen, Bosi, et al.
Publicado: (2026)

Multimodal RewardBench 2: Evaluating Omni Reward Models for Interleaved Text and Image
por: Hu, Yushi, et al.
Publicado: (2025)

RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment
por: Jin, Zhuoran, et al.
Publicado: (2024)

Med-RewardBench: Benchmarking Reward Models and Judges for Medical Multimodal Large Language Models
por: Ding, Meidan, et al.
Publicado: (2025)

WildGuard: Open One-Stop Moderation Tools for Safety Risks, Jailbreaks, and Refusals of LLMs
por: Han, Seungju, et al.
Publicado: (2024)

Explainable AI-Generated Image Detection RewardBench
por: Yang, Michael, et al.
Publicado: (2025)

Small Reward Models via Backward Inference
por: Wang, Yike, et al.
Publicado: (2026)

AI as Humanity's Salieri: Quantifying Linguistic Creativity of Language Models via Systematic Attribution of Machine Text against Web Text
por: Lu, Ximing, et al.
Publicado: (2024)

Generalizing Verifiable Instruction Following
por: Pyatkin, Valentina, et al.
Publicado: (2025)

What Makes it Ok to Set a Fire? Iterative Self-distillation of Contexts and Rationales for Disambiguating Defeasible Social and Moral Situations
por: Rao, Kavel, et al.
Publicado: (2023)

RL Grokking Recipe: How Does RL Unlock and Transfer New Algorithms in LLMs?
por: Sun, Yiyou, et al.
Publicado: (2025)

OMEGA: Can LLMs Reason Outside the Box in Math? Evaluating Exploratory, Compositional, and Transformative Generalization
por: Sun, Yiyou, et al.
Publicado: (2025)

Agent-RewardBench: Towards a Unified Benchmark for Reward Modeling across Perception, Planning, and Safety in Real-World Multimodal Agents
por: Men, Tianyi, et al.
Publicado: (2025)

Hybrid Preferences: Learning to Route Instances for Human vs. AI Feedback
por: Miranda, Lester James V., et al.
Publicado: (2024)

Merge to Learn: Efficiently Adding Skills to Language Models with Model Merging
por: Morrison, Jacob, et al.
Publicado: (2024)

Tulu 3: Pushing Frontiers in Open Language Model Post-Training
por: Lambert, Nathan, et al.
Publicado: (2024)

ComPO: Community Preferences for Language Model Personalization
por: Kumar, Sachin, et al.
Publicado: (2024)

Phenomenal Yet Puzzling: Testing Inductive Reasoning Capabilities of Language Models with Hypothesis Refinement
por: Qiu, Linlu, et al.
Publicado: (2023)

Agent Lumos: Unified and Modular Training for Open-Source Language Agents
por: Yin, Da, et al.
Publicado: (2023)

Selective "Selective Prediction": Reducing Unnecessary Abstention in Vision-Language Reasoning
por: Srinivasan, Tejas, et al.
Publicado: (2024)

L3GO: Language Agents with Chain-of-3D-Thoughts for Generating Unconventional Objects
por: Yamada, Yutaro, et al.
Publicado: (2024)

Train for Truth, Keep the Skills: Binary Retrieval-Augmented Reward Mitigates Hallucinations
por: Chen, Tong, et al.
Publicado: (2025)

Infini-gram mini: Exact n-gram Search at the Internet Scale with FM-Index
por: Xu, Hao, et al.
Publicado: (2025)

Infini-gram: Scaling Unbounded n-gram Language Models to a Trillion Tokens
por: Liu, Jiacheng, et al.
Publicado: (2024)

CULTURE-GEN: Revealing Global Cultural Perception in Language Models through Natural Language Prompting
por: Li, Huihan, et al.
Publicado: (2024)

Spurious Rewards: Rethinking Training Signals in RLVR
por: Shao, Rulin, et al.
Publicado: (2025)

APT: Adaptive Pruning and Tuning Pretrained Language Models for Efficient Training and Inference
por: Zhao, Bowen, et al.
Publicado: (2024)

Surfacing Semantic Orthogonality Across Model Safety Benchmarks: A Multi-Dimensional Analysis
por: Bennion, Jonathan, et al.
Publicado: (2025)

Set the Clock: Temporal Alignment of Pretrained Language Models
por: Zhao, Bowen, et al.
Publicado: (2024)