:: Library Catalog

Copertina

Salvato in:

Dettagli Bibliografici
Autori principali:	Kalra, Nimit, Tang, Leonard
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Computation and Language
Accesso online:	https://arxiv.org/abs/2502.18018
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Judge's Verdict: A Comprehensive Analysis of LLM Judge Capability Through Human Agreement
di: Han, Steve, et al.
Pubblicazione: (2025)

Reference-Guided Verdict: LLMs-as-Judges in Automatic Evaluation of Free-Form QA
di: Badshah, Sher, et al.
Pubblicazione: (2024)

REFLEX: Self-Refining Explainable Fact-Checking via Verdict-Anchored Style Control
di: Kong, Chuyi, et al.
Pubblicazione: (2025)

Domain Adaptation Through Task Distillation
di: Zhou, Brady, et al.
Pubblicazione: (2020)

Small Drafts, Big Verdict: Information-Intensive Visual Reasoning via Speculation
di: Liu, Yuhan, et al.
Pubblicazione: (2025)

Evaluating Judges as Evaluators: The JETTS Benchmark of LLM-as-Judges as Test-Time Scaling Evaluators
di: Zhou, Yilun, et al.
Pubblicazione: (2025)

Adaptive Rigor in AI System Evaluation using Temperature-Controlled Verdict Aggregation via Generalized Power Mean
di: Meshkov, Aleksandr
Pubblicazione: (2026)

J1: Exploring Simple Test-Time Scaling for LLM-as-a-Judge
di: Chan, Chi-Min, et al.
Pubblicazione: (2025)

RankJudge: A Multi-Turn LLM-as-a-Judge Synthetic Benchmark Generator
di: Tang, Zhenwei, et al.
Pubblicazione: (2026)

Forest-of-Thought: Scaling Test-Time Compute for Enhancing LLM Reasoning
di: Bi, Zhenni, et al.
Pubblicazione: (2024)

Inverse Scaling in Test-Time Compute
di: Gema, Aryo Pradipta, et al.
Pubblicazione: (2025)

LePaRD: A Large-Scale Dataset of Judges Citing Precedents
di: Mahari, Robert, et al.
Pubblicazione: (2023)

JudgeBench: A Benchmark for Evaluating LLM-based Judges
di: Tan, Sijun, et al.
Pubblicazione: (2024)

The Art of Scaling Test-Time Compute for Large Language Models
di: Agarwal, Aradhye, et al.
Pubblicazione: (2025)

Chain of Methodologies: Scaling Test Time Computation without Training
di: Liu, Cong, et al.
Pubblicazione: (2025)

Parallel Loop Transformer for Efficient Test-Time Computation Scaling
di: Wu, Bohong, et al.
Pubblicazione: (2025)

LLM-as-a-Judge for Time Series Explanations
di: Sivalingam, Preetham, et al.
Pubblicazione: (2026)

Computer-Use Agents as Judges for Generative User Interface
di: Lin, Kevin Qinghong, et al.
Pubblicazione: (2025)

Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models
di: Liu, Shuliang, et al.
Pubblicazione: (2025)

Prompt Attack Detection with LLM-as-a-Judge and Mixture-of-Models
di: Le, Hieu Xuan, et al.
Pubblicazione: (2026)

MR. Judge: Multimodal Reasoner as a Judge
di: Pi, Renjie, et al.
Pubblicazione: (2025)

Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judge
di: Shi, Lin, et al.
Pubblicazione: (2024)

Reassessing Extractive QA Datasets at Scale: LLM-as-a-Judge and In-Depth Analyses
di: Ho, Xanh, et al.
Pubblicazione: (2025)

Judging the Judges: Evaluating Alignment and Vulnerabilities in LLMs-as-Judges
di: Thakur, Aman Singh, et al.
Pubblicazione: (2024)

Who Judges the Judge? Evaluating LLM-as-a-Judge for French Medical open-ended QA
di: Belmadani, Ikram, et al.
Pubblicazione: (2026)

Adaptive Rectification Sampling for Test-Time Compute Scaling
di: Tan, Zhendong, et al.
Pubblicazione: (2025)

Test-Time Scaling Makes Overtraining Compute-Optimal
di: Roberts, Nicholas, et al.
Pubblicazione: (2026)

JudgeSense: A Benchmark for Prompt Sensitivity in LLM-as-a-Judge Systems
di: Bellibatlu, Rohith Reddy, et al.
Pubblicazione: (2026)

Better Language Model-Based Judging Reward Modeling through Scaling Comprehension Boundaries
di: Ning, Meiling, et al.
Pubblicazione: (2025)

Same Verdict, Different Reasons: LLM-as-a-Judge and Clinician Disagreement on Medical Chatbot Completeness
di: DeLucia, Alexandra, et al.
Pubblicazione: (2026)

The Silent Judge: Unacknowledged Shortcut Bias in LLM-as-a-Judge
di: Marioriyad, Arash, et al.
Pubblicazione: (2025)

FairJudge: An Adaptive, Debiased, and Consistent LLM-as-a-Judge
di: Yang, Bo, et al.
Pubblicazione: (2026)

Scaling Test-Time Compute Without Verification or RL is Suboptimal
di: Setlur, Amrith, et al.
Pubblicazione: (2025)

Assessing Judging Bias in Large Reasoning Models: An Empirical Study
di: Wang, Qian, et al.
Pubblicazione: (2025)

LLMs instead of Human Judges? A Large Scale Empirical Study across 20 NLP Evaluation Tasks
di: Bavaresco, Anna, et al.
Pubblicazione: (2024)

When Names Change Verdicts: Intervention Consistency Reveals Systematic Bias in LLM Decision-Making
di: Basu, Abhinaba, et al.
Pubblicazione: (2026)

CyclicJudge: Mitigating Judge Bias Efficiently in LLM-based Evaluation
di: Zhu, Ziyi, et al.
Pubblicazione: (2026)

Permutation-Consensus Listwise Judging for Robust Factuality Evaluation
di: Huang, Tianyi, et al.
Pubblicazione: (2026)

Scaling Natural-Language Graph-Based Test Time Compute for Automated Theorem Proving
di: Li, Vincent, et al.
Pubblicazione: (2025)

Case-Aware LLM-as-a-Judge Evaluation for Enterprise-Scale RAG Systems
di: Chhabra, Mukul, et al.
Pubblicazione: (2026)