Image de couverture de livre

Verdict: A Library for Scaling Judge-Time Compute

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Kalra, Nimit, Tang, Leonard
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Judge's Verdict: A Comprehensive Analysis of LLM Judge Capability Through Human Agreement
par: Han, Steve, et autres
Publié: (2025)

Reference-Guided Verdict: LLMs-as-Judges in Automatic Evaluation of Free-Form QA
par: Badshah, Sher, et autres
Publié: (2024)

REFLEX: Self-Refining Explainable Fact-Checking via Verdict-Anchored Style Control
par: Kong, Chuyi, et autres
Publié: (2025)

Evaluating Judges as Evaluators: The JETTS Benchmark of LLM-as-Judges as Test-Time Scaling Evaluators
par: Zhou, Yilun, et autres
Publié: (2025)

Small Drafts, Big Verdict: Information-Intensive Visual Reasoning via Speculation
par: Liu, Yuhan, et autres
Publié: (2025)

Domain Adaptation Through Task Distillation
par: Zhou, Brady, et autres
Publié: (2020)

Adaptive Rigor in AI System Evaluation using Temperature-Controlled Verdict Aggregation via Generalized Power Mean
par: Meshkov, Aleksandr
Publié: (2026)

J1: Exploring Simple Test-Time Scaling for LLM-as-a-Judge
par: Chan, Chi-Min, et autres
Publié: (2025)

RankJudge: A Multi-Turn LLM-as-a-Judge Synthetic Benchmark Generator
par: Tang, Zhenwei, et autres
Publié: (2026)

Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoning
par: Bi, Zhenni, et autres
Publié: (2024)

LePaRD: A Large-Scale Dataset of Judges Citing Precedents
par: Mahari, Robert, et autres
Publié: (2023)

Inverse Scaling in Test-Time Compute
par: Gema, Aryo Pradipta, et autres
Publié: (2025)

The Art of Scaling Test-Time Compute for Large Language Models
par: Agarwal, Aradhye, et autres
Publié: (2025)

Chain of Methodologies: Scaling Test Time Computation without Training
par: Liu, Cong, et autres
Publié: (2025)

Parallel Loop Transformer for Efficient Test-Time Computation Scaling
par: Wu, Bohong, et autres
Publié: (2025)

Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models
par: Liu, Shuliang, et autres
Publié: (2025)

Reassessing Extractive QA Datasets at Scale: LLM-as-a-Judge and In-Depth Analyses
par: Ho, Xanh, et autres
Publié: (2025)

MR. Judge: Multimodal Reasoner as a Judge
par: Pi, Renjie, et autres
Publié: (2025)

LLM-as-a-Judge for Time Series Explanations
par: Sivalingam, Preetham, et autres
Publié: (2026)

Prompt Attack Detection with LLM-as-a-Judge and Mixture-of-Models
par: Le, Hieu Xuan, et autres
Publié: (2026)

JudgeBench: A Benchmark for Evaluating LLM-based Judges
par: Tan, Sijun, et autres
Publié: (2024)

Who Judges the Judge? Evaluating LLM-as-a-Judge for French Medical open-ended QA
par: Belmadani, Ikram, et autres
Publié: (2026)

Adaptive Rectification Sampling for Test-Time Compute Scaling
par: Tan, Zhendong, et autres
Publié: (2025)

Test-Time Scaling Makes Overtraining Compute-Optimal
par: Roberts, Nicholas, et autres
Publié: (2026)

Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judge
par: Shi, Lin, et autres
Publié: (2024)

JudgeSense: A Benchmark for Prompt Sensitivity in LLM-as-a-Judge Systems
par: Bellibatlu, Rohith Reddy, et autres
Publié: (2026)

Computer-Use Agents as Judges for Generative User Interface
par: Lin, Kevin Qinghong, et autres
Publié: (2025)

Better Language Model-Based Judging Reward Modeling through Scaling Comprehension Boundaries
par: Ning, Meiling, et autres
Publié: (2025)

Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges
par: Thakur, Aman Singh, et autres
Publié: (2024)

The Silent Judge: Unacknowledged Shortcut Bias in LLM-as-a-Judge
par: Marioriyad, Arash, et autres
Publié: (2025)

FairJudge: An Adaptive, Debiased, and Consistent LLM-as-a-Judge
par: Yang, Bo, et autres
Publié: (2026)

LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks
par: Bavaresco, Anna, et autres
Publié: (2024)

Scaling Natural-Language Graph-Based Test Time Compute for Automated Theorem Proving
par: Li, Vincent, et autres
Publié: (2025)

Scaling Test-Time Compute Without Verification or RL is Suboptimal
par: Setlur, Amrith, et autres
Publié: (2025)

CyclicJudge: Mitigating Judge Bias Efficiently in LLM-based Evaluation
par: Zhu, Ziyi, et autres
Publié: (2026)

Time to REFLECT: Can We Trust LLM Judges for Evidence-based Research Agents?
par: Wang, Leyao, et autres
Publié: (2026)

Same Verdict, Different Reasons: LLM-as-a-Judge and Clinician Disagreement on Medical Chatbot Completeness
par: DeLucia, Alexandra, et autres
Publié: (2026)

Assessing Judging Bias in Large Reasoning Models: An Empirical Study
par: Wang, Qian, et autres
Publié: (2025)

GenPRM: Scaling Test-Time Compute of Process Reward Models via Generative Reasoning
par: Zhao, Jian, et autres
Publié: (2025)

Towards Thinking-Optimal Scaling of Test-Time Compute for LLM Reasoning
par: Yang, Wenkai, et autres
Publié: (2025)