Cover Image

CheckEval: A reliable LLM-as-a-Judge framework for evaluating text generation using checklists

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Lee, Yukyung, Kim, Joonghoon, Kim, Jaehee, Cho, Hyowon, Kang, Jaewook, Kang, Pilsung, Kim, Najoung
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

AlienLM: Alienization of Language for API-Boundary Privacy in Black-Box LLMs
by: Kim, Jaehee, et al.
Published: (2026)

A Gradient Accumulation Method for Dense Retriever under Memory Constraint
by: Kim, Jaehee, et al.
Published: (2024)

Navigating the Path of Writing: Outline-guided Text Generation with Large Language Models
by: Lee, Yukyung, et al.
Published: (2024)

A systematic framework for generating novel experimental hypotheses from language models
by: Misra, Kanishka, et al.
Published: (2024)

RExBench: Can coding agents autonomously implement AI research extensions?
by: Edwards, Nicholas, et al.
Published: (2025)

QFFN-BERT: An Empirical Study of Depth, Performance, and Data Efficiency in Hybrid Quantum-Classical Transformers
by: Kang, Pilsung
Published: (2025)

RadEval: A framework for radiology text evaluation
by: Xu, Justin, et al.
Published: (2025)

Can You Trick the Grader? Adversarial Persuasion of LLM Judges
by: Hwang, Yerin, et al.
Published: (2025)

Don't Judge Code by Its Cover: Exploring Biases in LLM Judges for Code Evaluation
by: Moon, Jiwon, et al.
Published: (2025)

Is analogy enough to draw novel adjective-noun inferences?
by: Ross, Hayley, et al.
Published: (2025)

Syn-QA2: Evaluating False Assumptions in Long-tail Questions with Synthetic QA Datasets
by: Daswani, Ashwin, et al.
Published: (2024)

Is artificial intelligence still intelligence? LLMs generalize to novel adjective-noun pairs, but don't mimic the full human distribution
by: Ross, Hayley, et al.
Published: (2024)

COUNTDOWN: Contextually Sparse Activation Filtering Out Unnecessary Weights in Down Projection
by: Cheon, Jaewon, et al.
Published: (2025)

MM-Eval: A Multilingual Meta-Evaluation Benchmark for LLM-as-a-Judge and Reward Models
by: Son, Guijin, et al.
Published: (2024)

Code Pretraining Improves Entity Tracking Abilities of Language Models
by: Kim, Najoung, et al.
Published: (2024)

Asking Is Not Enough: Protocol Sensitivity in LLM Confidence Calibration
by: Kim, Hankyeol, et al.
Published: (2026)

Natural Language Declarative Prompting (NLD-P): A Modular Governance Method for Prompt Design Under Model Drift
by: Kim, Hyunwoo, et al.
Published: (2026)

Judging Against the Reference: Uncovering Knowledge-Driven Failures in LLM-Judges on QA Evaluation
by: Lee, Dongryeol, et al.
Published: (2026)

VERISCORE: Evaluating the factuality of verifiable claims in long-form text generation
by: Song, Yixiao, et al.
Published: (2024)

Death of the Novel(ty): Beyond n-Gram Novelty as a Metric for Textual Creativity
by: Saakyan, Arkadiy, et al.
Published: (2025)

Self-Correcting Code Generation Using Small Language Models
by: Cho, Jeonghun, et al.
Published: (2025)

FeedEval: Pedagogically Aligned Evaluation of LLM-Generated Essay Feedback
by: Chu, Seongyeub, et al.
Published: (2026)

Are LLM-Judges Robust to Expressions of Uncertainty? Investigating the effect of Epistemic Markers on LLM-based Evaluation
by: Lee, Dongryeol, et al.
Published: (2024)

LLM-as-a-Judge & Reward Model: What They Can and Cannot Do
by: Son, Guijin, et al.
Published: (2024)

Fooling the LVLM Judges: Visual Biases in LVLM-Based Evaluation
by: Hwang, Yerin, et al.
Published: (2025)

naPINN: Noise-Adaptive Physics-Informed Neural Networks for Recovering Physics from Corrupted Measurement
by: Kim, Hankyeol, et al.
Published: (2026)

Can Large Language Models Differentiate Harmful from Argumentative Essays? Steps Toward Ethical Essay Scoring
by: Kim, Hongjin, et al.
Published: (2026)

Generation-Based and Emotion-Reflected Memory Update: Creating the KEEM Dataset for Better Long-Term Conversation
by: Kang, Jeonghyun, et al.
Published: (2026)

PsyProbe: Proactive and Interpretable Dialogue through User State Modeling for Exploratory Counseling
by: Park, Sohhyung, et al.
Published: (2026)

EvalLM: Interactive Evaluation of Large Language Model Prompts on User-Defined Criteria
by: Kim, Tae Soo, et al.
Published: (2023)

PersonaEval: Are LLM Evaluators Human Enough to Judge Role-Play?
by: Zhou, Lingfeng, et al.
Published: (2025)

Verbosity-Aware Rationale Reduction: Effective Reduction of Redundant Rationale via Principled Criteria
by: Jang, Joonwon, et al.
Published: (2024)

Cactus: Towards Psychological Counseling Conversations using Cognitive Behavioral Theory
by: Lee, Suyeon, et al.
Published: (2024)

Open Ko-LLM Leaderboard: Evaluating Large Language Models in Korean with Ko-H5 Benchmark
by: Park, Chanjun, et al.
Published: (2024)

KFinEval-Pilot: A Comprehensive Benchmark Suite for Korean Financial Language Understanding
by: Hwang, Bokwang, et al.
Published: (2025)

Prometheus-Vision: Vision-Language Model as a Judge for Fine-Grained Evaluation
by: Lee, Seongyun, et al.
Published: (2024)

Training-free Dropout Sampling for Semantic Token Acceptance in Speculative Decoding
by: Lee, Jeongtae, et al.
Published: (2026)

Review-driven Personalized Preference Reasoning with Large Language Models for Recommendation
by: Kim, Jieyong, et al.
Published: (2024)

Towards Fully-Automated Materials Discovery via Large-Scale Synthesis Dataset and Expert-Level LLM-as-a-Judge
by: Kim, Heegyu, et al.
Published: (2025)

Investigating the Influence of Prompt-Specific Shortcuts in AI Generated Text Detection
by: Park, Choonghyun, et al.
Published: (2024)