Image de couverture de livre

FairJudge: An Adaptive, Debiased, and Consistent LLM-as-a-Judge

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Yang, Bo, Feng, Lanfei, Chen, Yunkui, Zhang, Yu, Xu, Xiao, Li, Shijian
Format:	Preprint
Publié:	2026
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

ZPD Detector: Data Selection via Capability-Difficulty Alignment for Large Language Models
par: Yang, Bo, et autres
Publié: (2026)

AgriAgent: Contract-Driven Planning and Capability-Aware Tool Orchestration in Real-World Agriculture
par: Yang, Bo, et autres
Publié: (2026)

AgriGPT-Omni: A Unified Speech-Vision-Text Framework for Multilingual Agricultural Intelligence
par: Yang, Bo, et autres
Publié: (2025)

AgriGPT-VL: Agricultural Vision-Language Understanding Suite
par: Yang, Bo, et autres
Publié: (2025)

FairJudge: Abstention-Aware Multimodal Judges for Fairness and Alignment Evaluation in Text-to-Image Models
par: Sahili, Zahraa Al, et autres
Publié: (2025)

Toward Robust LLM-Based Judges: Taxonomic Bias Evaluation and Debiasing Optimization
par: Zhou, Hongli, et autres
Publié: (2026)

Judge as A Judge: Improving the Evaluation of Retrieval-Augmented Generation through the Judge-Consistency of Large Language Models
par: Liu, Shuliang, et autres
Publié: (2025)

TrustJudge: Inconsistencies of LLM-as-a-Judge and How to Alleviate Them
par: Wang, Yidong, et autres
Publié: (2025)

Fairness or Fluency? An Investigation into Language Bias of Pairwise LLM-as-a-Judge
par: Zhou, Xiaolin, et autres
Publié: (2026)

Who Judges the Judge? Evaluating LLM-as-a-Judge for French Medical open-ended QA
par: Belmadani, Ikram, et autres
Publié: (2026)

The Silent Judge: Unacknowledged Shortcut Bias in LLM-as-a-Judge
par: Marioriyad, Arash, et autres
Publié: (2025)

JudgeSense: A Benchmark for Prompt Sensitivity in LLM-as-a-Judge Systems
par: Bellibatlu, Rohith Reddy, et autres
Publié: (2026)

CyclicJudge: Mitigating Judge Bias Efficiently in LLM-based Evaluation
par: Zhu, Ziyi, et autres
Publié: (2026)

Judging the Judges: A Systematic Study of Position Bias in LLM-as-a-Judge
par: Shi, Lin, et autres
Publié: (2024)

BadJudge: Backdoor Vulnerabilities of LLM-as-a-Judge
par: Tong, Terry, et autres
Publié: (2025)

Any Large Language Model Can Be a Reliable Judge: Debiasing with a Reasoning-based Bias Detector
par: Yang, Haoyan, et autres
Publié: (2025)

Evaluating Scoring Bias in LLM-as-a-Judge
par: Li, Qingquan, et autres
Publié: (2025)

The Necessity of Setting Temperature in LLM-as-a-Judge
par: Li, Lujun, et autres
Publié: (2026)

An Empirical Study of LLM-as-a-Judge for LLM Evaluation: Fine-tuned Judge Model is not a General Substitute for GPT-4
par: Huang, Hui, et autres
Publié: (2024)

Agent-as-a-Judge
par: You, Runyang, et autres
Publié: (2026)

MLLM-as-a-Judge: Assessing Multimodal LLM-as-a-Judge with Vision-Language Benchmark
par: Chen, Dongping, et autres
Publié: (2024)

One Token to Fool LLM-as-a-Judge
par: Zhao, Yulai, et autres
Publié: (2025)

Improve LLM-as-a-Judge Ability as a General Ability
par: Yu, Jiachen, et autres
Publié: (2025)

A Survey on LLM-as-a-Judge
par: Gu, Jiawei, et autres
Publié: (2024)

Curse of Knowledge: When Complex Evaluation Context Benefits yet Biases LLM Judges
par: Li, Weiyuan, et autres
Publié: (2025)

Beyond Single-Point Judgment: Distribution Alignment for LLM-as-a-Judge
par: Chen, Luyu, et autres
Publié: (2025)

Are We on the Right Way to Assessing LLM-as-a-Judge?
par: Feng, Yuanning, et autres
Publié: (2025)

MR. Judge: Multimodal Reasoner as a Judge
par: Pi, Renjie, et autres
Publié: (2025)

SEAL: Can Saturated Benchmarks Be Revived by LLM-as-a-Meta-Judge?
par: Chen, Jiamin, et autres
Publié: (2026)

Judge Anything: MLLM as a Judge Across Any Modality
par: Pu, Shu, et autres
Publié: (2025)

Dialectal Toxicity Detection: Evaluating LLM-as-a-Judge Consistency Across Language Varieties
par: Faisal, Fahim, et autres
Publié: (2024)

Multi-Task Reinforcement Learning for Enhanced Multimodal LLM-as-a-Judge
par: Wu, Junjie, et autres
Publié: (2026)

CodeJudgeBench: Benchmarking LLM-as-a-Judge for Coding Tasks
par: Jiang, Hongchao, et autres
Publié: (2025)

AdaJudge: Adaptive Multi-Perspective Judging for Reward Modeling
par: Miao, Yongliang, et autres
Publié: (2026)

Learning an Efficient Multi-Turn Dialogue Evaluator from Multiple LLM Judges
par: Tang, Yuqi, et autres
Publié: (2025)

RankJudge: A Multi-Turn LLM-as-a-Judge Synthetic Benchmark Generator
par: Tang, Zhenwei, et autres
Publié: (2026)

Benchmarking LLM-as-a-Judge for Long-Form Output Evaluation
par: Chen, Junjie, et autres
Publié: (2026)

Justice or Prejudice? Quantifying Biases in LLM-as-a-Judge
par: Ye, Jiayi, et autres
Publié: (2024)

Quantitative LLM Judges
par: Sahoo, Aishwarya, et autres
Publié: (2025)

Assistant-Guided Mitigation of Teacher Preference Bias in LLM-as-a-Judge
par: Liu, Zhuo, et autres
Publié: (2025)