Copertina

IF-RewardBench: Benchmarking Judge Models for Instruction-Following Evaluation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Wen, Bosi, Niu, Yilin, Wang, Cunxiang, Ling, Xiaoying, Zhang, Ying, Ke, Pei, Wang, Hongning, Huang, Minlie
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

IF-CRITIC: Towards a Fine-Grained LLM Critic for Instruction-Following Evaluation
di: Wen, Bosi, et al.
Pubblicazione: (2025)

RLAR: An Agentic Reward System for Multi-task Reinforcement Learning on Large Language Models
di: Feng, Andrew Zhuoer, et al.
Pubblicazione: (2026)

HPSS: Heuristic Prompting Strategy Search for LLM Evaluators
di: Wen, Bosi, et al.
Pubblicazione: (2025)

Med-RewardBench: Benchmarking Reward Models and Judges for Medical Multimodal Large Language Models
di: Ding, Meidan, et al.
Pubblicazione: (2025)

Benchmarking Complex Instruction-Following with Multiple Constraints Composition
di: Wen, Bosi, et al.
Pubblicazione: (2024)

RewardBench 2: Advancing Reward Model Evaluation
di: Malik, Saumya, et al.
Pubblicazione: (2025)

Personalized RewardBench: Evaluating Reward Models with Human Aligned Personalization
di: Ma, Qiyao, et al.
Pubblicazione: (2026)

Language Model Decoding as Direct Metrics Optimization
di: Ji, Haozhe, et al.
Pubblicazione: (2023)

Long-form RewardBench: Evaluating Reward Models for Long-form Generation
di: Huang, Hui, et al.
Pubblicazione: (2026)

M-RewardBench: Evaluating Reward Models in Multilingual Settings
di: Gureja, Srishti, et al.
Pubblicazione: (2024)

HoWToBench: Holistic Evaluation for LLM's Capability in Human-level Writing using Tree of Writing
di: Feng, Andrew Zhuoer, et al.
Pubblicazione: (2026)

RAVEL: Reasoning Agents for Validating and Evaluating LLM Text Synthesis
di: Feng, Andrew Zhuoer, et al.
Pubblicazione: (2026)

CharacterBench: Benchmarking Character Customization of Large Language Models
di: Zhou, Jinfeng, et al.
Pubblicazione: (2024)

VL-RewardBench: A Challenging Benchmark for Vision-Language Generative Reward Models
di: Li, Lei, et al.
Pubblicazione: (2024)

SPaR: Self-Play with Tree-Search Refinement to Improve Instruction-Following in Large Language Models
di: Cheng, Jiale, et al.
Pubblicazione: (2024)

Towards Efficient Exact Optimization of Language Model Alignment
di: Ji, Haozhe, et al.
Pubblicazione: (2024)

RAG-RewardBench: Benchmarking Reward Models in Retrieval Augmented Generation for Preference Alignment
di: Jin, Zhuoran, et al.
Pubblicazione: (2024)

Multimodal RewardBench 2: Evaluating Omni Reward Models for Interleaved Text and Image
di: Hu, Yushi, et al.
Pubblicazione: (2025)

Learning Task Decomposition to Assist Humans in Competitive Programming
di: Wen, Jiaxin, et al.
Pubblicazione: (2024)

AlignBench: Benchmarking Chinese Alignment of Large Language Models
di: Liu, Xiao, et al.
Pubblicazione: (2023)

Defending Large Language Models Against Jailbreaking Attacks Through Goal Prioritization
di: Zhang, Zhexin, et al.
Pubblicazione: (2023)

Training Language Model to Critique for Better Refinement
di: Yu, Tianshu, et al.
Pubblicazione: (2025)

Agent-SafetyBench: Evaluating the Safety of LLM Agents
di: Zhang, Zhexin, et al.
Pubblicazione: (2024)

CritiqueLLM: Towards an Informative Critique Generation Model for Evaluation of Large Language Model Generation
di: Ke, Pei, et al.
Pubblicazione: (2023)

CMI-RewardBench: Evaluating Music Reward Models with Compositional Multimodal Instruction
di: Ma, Yinghao, et al.
Pubblicazione: (2026)

LongSafety: Evaluating Long-Context Safety of Large Language Models
di: Lu, Yida, et al.
Pubblicazione: (2025)

RewardBench: Evaluating Reward Models for Language Modeling
di: Lambert, Nathan, et al.
Pubblicazione: (2024)

Agent-RewardBench: Towards a Unified Benchmark for Reward Modeling across Perception, Planning, and Safety in Real-World Multimodal Agents
di: Men, Tianyi, et al.
Pubblicazione: (2025)

Unlocking Reasoning Potential in Large Langauge Models by Scaling Code-form Planning
di: Wen, Jiaxin, et al.
Pubblicazione: (2024)

MCJudgeBench: A Benchmark for Constraint-Level Judge Evaluation in Multi-Constraint Instruction Following
di: Lee, Jaeyun, et al.
Pubblicazione: (2026)

Black-Box Prompt Optimization: Aligning Large Language Models without Model Training
di: Cheng, Jiale, et al.
Pubblicazione: (2023)

CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models
di: LI, Yizhi, et al.
Pubblicazione: (2024)

Multimodal RewardBench: Holistic Evaluation of Reward Models for Vision Language Models
di: Yasunaga, Michihiro, et al.
Pubblicazione: (2025)

AMOR: A Recipe for Building Adaptable Modular Knowledge Agents Through Process Feedback
di: Guan, Jian, et al.
Pubblicazione: (2024)

JudgeBench: A Benchmark for Evaluating LLM-based Judges
di: Tan, Sijun, et al.
Pubblicazione: (2024)

ChatGLM-RLHF: Practices of Aligning Large Language Models with Human Feedback
di: Hou, Zhenyu, et al.
Pubblicazione: (2024)

Does RLHF Scale? Exploring the Impacts From Data, Model, and Method
di: Hou, Zhenyu, et al.
Pubblicazione: (2024)

From Theft to Bomb-Making: The Ripple Effect of Unlearning in Defending Against Jailbreak Attacks
di: Zhang, Zhexin, et al.
Pubblicazione: (2024)

Explainable AI-Generated Image Detection RewardBench
di: Yang, Michael, et al.
Pubblicazione: (2025)

RefuteBench: Evaluating Refuting Instruction-Following for Large Language Models
di: Yan, Jianhao, et al.
Pubblicazione: (2024)