Cover Image

LLMs-as-Judges: A Comprehensive Survey on LLM-based Evaluation Methods

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Haitao, Dong, Qian, Chen, Junjie, Su, Huixue, Zhou, Yujia, Ai, Qingyao, Ye, Ziyi, Liu, Yiqun
Format:	Preprint
Published:	2024
Subjects:	Computation and Language Information Retrieval
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

RbFT: Robust Fine-tuning for Retrieval-Augmented Generation against Retrieval Defects
by: Tu, Yiteng, et al.
Published: (2025)

SurGE: A Benchmark and Evaluation Framework for Scientific Survey Generation
by: Su, Weihang, et al.
Published: (2025)

PRE: A Peer Review Based Large Language Model Evaluator
by: Chu, Zhumin, et al.
Published: (2024)

Dynamic and Parametric Retrieval-Augmented Generation
by: Su, Weihang, et al.
Published: (2025)

Parametric Retrieval Augmented Generation
by: Su, Weihang, et al.
Published: (2025)

Enhancing LLM-Based Agents via Global Planning and Hierarchical Execution
by: Chen, Junjie, et al.
Published: (2025)

DELTA: Pre-train a Discriminative Encoder for Legal Case Retrieval via Structural Word Alignment
by: Li, Haitao, et al.
Published: (2024)

Multi-Field Tool Retrieval
by: Tang, Yichen, et al.
Published: (2026)

DRAGIN: Dynamic Retrieval Augmented Generation based on the Information Needs of Large Language Models
by: Su, Weihang, et al.
Published: (2024)

LegalAgentBench: Evaluating LLM Agents in Legal Domain
by: Li, Haitao, et al.
Published: (2024)

Towards Unification of Hallucination Detection and Fact Verification for Large Language Models
by: Su, Weihang, et al.
Published: (2025)

CrossPT-EEG: A Benchmark for Cross-Participant and Cross-Time Generalization of EEG-based Visual Decoding
by: Zhu, Shuqi, et al.
Published: (2024)

LexRAG: Benchmarking Retrieval-Augmented Generation in Multi-Turn Legal Consultation Conversation
by: Li, Haitao, et al.
Published: (2025)

Enhancing Judgment Document Generation via Agentic Legal Information Collection and Rubric-Guided Optimization
by: Su, Weihang, et al.
Published: (2026)

Towards an In-Depth Comprehension of Case Relevance for Better Legal Retrieval
by: Li, Haitao, et al.
Published: (2024)

Mitigating Entity-Level Hallucination in Large Language Models
by: Su, Weihang, et al.
Published: (2024)

Beyond Exposure: Optimizing Ranking Fairness with Non-linear Time-Income Functions
by: Li, Xuancheng, et al.
Published: (2026)

Scaling Laws For Dense Retrieval
by: Fang, Yan, et al.
Published: (2024)

Analytical Search
by: Tu, Yiteng, et al.
Published: (2026)

Query Augmentation by Decoding Semantics from Brain Signals
by: Ye, Ziyi, et al.
Published: (2024)

SelfRACG: Enabling LLMs to Self-Express and Retrieve for Code Generation
by: Dong, Qian, et al.
Published: (2025)

Qilin: A Multimodal Information Retrieval Dataset with APP-level User Sessions
by: Chen, Jia, et al.
Published: (2025)

CalibraEval: Calibrating Prediction Distribution to Mitigate Selection Bias in LLMs-as-Judges
by: Li, Haitao, et al.
Published: (2024)

Generalized Pseudo-Relevance Feedback
by: Tu, Yiteng, et al.
Published: (2025)

Improving Legal Case Retrieval with Brain Signals
by: Zhang, Ruizhe, et al.
Published: (2024)

STARD: A Chinese Statute Retrieval Dataset with Real Queries Issued by Non-professionals
by: Su, Weihang, et al.
Published: (2024)

I^3 Retriever: Incorporating Implicit Interaction in Pre-trained Language Models for Passage Retrieval
by: Dong, Qian, et al.
Published: (2023)

EEG-SVRec: An EEG Dataset with User Multidimensional Affective Engagement Labels in Short Video Recommendation
by: Zhang, Shaorun, et al.
Published: (2024)

Equity vs. Equality: Optimizing Ranking Fairness for Tailored Provider Needs
by: Tu, Yiteng, et al.
Published: (2026)

Multi-Source Retrieval and Reasoning for Legal Sentencing Prediction
by: Chen, Junjie, et al.
Published: (2026)

Foundations of GenIR
by: Ai, Qingyao, et al.
Published: (2025)

Unsupervised Large Language Model Alignment for Information Retrieval via Contrastive Feedback
by: Dong, Qian, et al.
Published: (2023)

Reinforcement Learning to Rank Using Coarse-grained Rewards
by: Tu, Yiteng, et al.
Published: (2022)

Caseformer: Pre-training for Legal Case Retrieval Based on Inter-Case Distinctions
by: Su, Weihang, et al.
Published: (2023)

Capability-aware Prompt Reformulation Learning for Text-to-Image Generation
by: Zhan, Jingtao, et al.
Published: (2024)

JuDGE: Benchmarking Judgment Document Generation for Chinese Legal System
by: Su, Weihang, et al.
Published: (2025)

Benchmarking LLM-as-a-Judge for Long-Form Output Evaluation
by: Chen, Junjie, et al.
Published: (2026)

MemoryBench: A Benchmark for Memory and Continual Learning in LLM Systems
by: Ai, Qingyao, et al.
Published: (2025)

Unsupervised dense retrieval with conterfactual contrastive learning
by: Chen, Haitian, et al.
Published: (2024)

Sequential Recommendation with Latent Relations based on Large Language Model
by: Yang, Shenghao, et al.
Published: (2024)