Imagen de Portada

JudgeBoard: Benchmarking and Enhancing Small Language Models for Reasoning Evaluation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Bi, Zhenyu, Srivastava, Gaurav, Li, Yang, Lu, Meng, Roy, Swastik, Ziyadi, Morteza, Wang, Xuan
Formato:	Preprint
Publicado:	2025
Materias:	Artificial Intelligence Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

BeyondBench: Contamination-Resistant Evaluation of Reasoning in Language Models
por: Srivastava, Gaurav, et al.
Publicado: (2025)

OPTAGENT: Optimizing Multi-Agent LLM Interactions Through Verbal Reinforcement Learning for Enhanced Reasoning
por: Bi, Zhenyu, et al.
Publicado: (2025)

DEBATE, TRAIN, EVOLVE: Self Evolution of Language Model Reasoning
por: Srivastava, Gaurav, et al.
Publicado: (2025)

Towards Reasoning Ability of Small Language Models
por: Srivastava, Gaurav, et al.
Publicado: (2025)

C-MORAL: Controllable Multi-Objective Molecular Optimization with Reinforcement Alignment for LLMs
por: Gao, Rui, et al.
Publicado: (2026)

EffGen: Enabling Small Language Models as Capable Autonomous Agents
por: Srivastava, Gaurav, et al.
Publicado: (2026)

Evaluating Large Language Models for Financial Reasoning: A CFA-Based Benchmark Study
por: Yao, Xuan, et al.
Publicado: (2025)

STOC-TOT: Stochastic Tree-of-Thought with Constrained Decoding for Complex Reasoning in Multi-Hop Question Answering
por: Bi, Zhenyu, et al.
Publicado: (2024)

InfiR : Crafting Effective Small Language Models and Multimodal Small Language Models in Reasoning
por: Xie, Congkai, et al.
Publicado: (2025)

SpeechR: A Benchmark for Speech Reasoning in Large Audio-Language Models
por: Yang, Wanqi, et al.
Publicado: (2025)

Functional Benchmarks for Robust Evaluation of Reasoning Performance, and the Reasoning Gap
por: Srivastava, Saurabh, et al.
Publicado: (2024)

JudgeLRM: Large Reasoning Models as a Judge
por: Chen, Nuo, et al.
Publicado: (2025)

CEI: A Benchmark for Evaluating Pragmatic Reasoning in Language Models
por: Chun, Jon, et al.
Publicado: (2026)

Mind2Web 2: Evaluating Agentic Search with Agent-as-a-Judge
por: Gou, Boyu, et al.
Publicado: (2025)

MedCritical: Enhancing Medical Reasoning in Small Language Models via Self-Collaborative Correction
por: Su, Xinchun, et al.
Publicado: (2025)

CLASH: Evaluating Language Models on Judging High-Stakes Dilemmas from Multiple Perspectives
por: Lee, Ayoung, et al.
Publicado: (2025)

The Point of No Return: Counterfactual Localization of Deceptive Commitment in Language-Model Reasoning
por: Merrill, Scott, et al.
Publicado: (2026)

JAILJUDGE: A Comprehensive Jailbreak Judge Benchmark with Multi-Agent Enhanced Explanation Evaluation Framework
por: Liu, Fan, et al.
Publicado: (2024)

Igniting Creative Writing in Small Language Models: LLM-as-a-Judge versus Multi-Agent Refined Rewards
por: Wei, Xiaolong, et al.
Publicado: (2025)

JudgeRank: Leveraging Large Language Models for Reasoning-Intensive Reranking
por: Niu, Tong, et al.
Publicado: (2024)

LTLBench: Towards Benchmarks for Evaluating Temporal Reasoning in Large Language Models
por: Tang, Weizhi, et al.
Publicado: (2024)

JudgeBench: A Benchmark for Evaluating LLM-based Judges
por: Tan, Sijun, et al.
Publicado: (2024)

GR-Ben: A General Reasoning Benchmark for Evaluating Process Reward Models
por: Sun, Zhouhao, et al.
Publicado: (2026)

TReB: A Comprehensive Benchmark for Evaluating Table Reasoning Capabilities of Large Language Models
por: Li, Ce, et al.
Publicado: (2025)

Unmasking Reasoning Processes: A Process-aware Benchmark for Evaluating Structural Mathematical Reasoning in LLMs
por: Zheng, Xiang, et al.
Publicado: (2026)

LightReasoner: Can Small Language Models Teach Large Language Models Reasoning?
por: Wang, Jingyuan, et al.
Publicado: (2025)

Mathematical Reasoning in Large Language Models: Benchmarks, Architectures, Evaluation, and Open Challenges
por: Amjad, Husnain, et al.
Publicado: (2026)

Speculative Thinking: Enhancing Small-Model Reasoning with Large Model Guidance at Inference Time
por: Yang, Wang, et al.
Publicado: (2025)

Learning to Plan & Reason for Evaluation with Thinking-LLM-as-a-Judge
por: Saha, Swarnadeep, et al.
Publicado: (2025)

Evaluating Clinical Competencies of Large Language Models with a General Practice Benchmark
por: Li, Zheqing, et al.
Publicado: (2025)

Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges
por: Thakur, Aman Singh, et al.
Publicado: (2024)

Is LLM an Overconfident Judge? Unveiling the Capabilities of LLMs in Detecting Offensive Language with Annotation Disagreement
por: Lu, Junyu, et al.
Publicado: (2025)

Evaluating and Enhancing Large Language Models for Conversational Reasoning on Knowledge Graphs
por: Huang, Yuxuan
Publicado: (2023)

EpiQAL: Benchmarking Large Language Models in Epidemiological Question Answering and Reasoning
por: Wei, Mingyang, et al.
Publicado: (2026)

Rethinking LLM-as-a-Judge: Representation-as-a-Judge with Small Language Models via Semantic Capacity Asymmetry
por: Li, Zhuochun, et al.
Publicado: (2026)

Distilling Mathematical Reasoning Capabilities into Small Language Models
por: Zhu, Xunyu, et al.
Publicado: (2024)

Efficient Long CoT Reasoning in Small Language Models
por: Wang, Zhaoyang, et al.
Publicado: (2025)

Enhance Reasoning for Large Language Models in the Game Werewolf
por: Wu, Shuang, et al.
Publicado: (2024)

AtomWorld: A Benchmark for Evaluating Spatial Reasoning in Large Language Models on Crystalline Materials
por: Lv, Taoyuze, et al.
Publicado: (2025)

JudgeLM: Fine-tuned Large Language Models are Scalable Judges
por: Zhu, Lianghui, et al.
Publicado: (2023)