Cover Image

Themis: A Reference-free NLG Evaluation Language Model with Flexibility and Interpretability

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Hu, Xinyu, Lin, Li, Gao, Mingqi, Yin, Xunjian, Wan, Xiaojun
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Analyzing and Evaluating Correlation Measures in NLG Meta-Evaluation
by: Gao, Mingqi, et al.
Published: (2024)

A Dual-Perspective NLG Meta-Evaluation Framework with Automatic Benchmark and Better Interpretability
by: Hu, Xinyu, et al.
Published: (2025)

Exploring the Multilingual NLG Evaluation Abilities of LLM-Based Evaluators
by: Chang, Jiayi, et al.
Published: (2025)

LLM-based NLG Evaluation: Current Status and Challenges
by: Gao, Mingqi, et al.
Published: (2024)

Evaluating Self-Generated Documents for Enhancing Retrieval-Augmented Generation with Large Language Models
by: Li, Jiatao, et al.
Published: (2024)

Are LLM-based Evaluators Confusing NLG Quality Criteria?
by: Hu, Xinyu, et al.
Published: (2024)

Better than Random: Reliable NLG Human Evaluation with Constrained Active Sampling
by: Ruan, Jie, et al.
Published: (2024)

Benchmarking Knowledge Boundary for Large Language Models: A Different Perspective on Model Evaluation
by: Yin, Xunjian, et al.
Published: (2024)

ContraSolver: Self-Alignment of Language Models by Resolving Internal Preference Contradictions
by: Zhang, Xu, et al.
Published: (2024)

Error-Robust Retrieval for Chinese Spelling Check
by: Yin, Xunjian, et al.
Published: (2022)

Aspect-Guided Multi-Level Perturbation Analysis of Large Language Models in Automated Peer Review
by: Li, Jiatao, et al.
Published: (2025)

DSGram: Dynamic Weighting Sub-Metrics for Grammatical Error Correction in the Era of Large Language Models
by: Xie, Jinxiang, et al.
Published: (2024)

AGENT-X: Adaptive Guideline-based Expert Network for Threshold-free AI-generated teXt detection
by: Li, Jiatao, et al.
Published: (2025)

MINOS: A Multimodal Evaluation Model for Bidirectional Generation Between Image and Text
by: Zhang, Junzhe, et al.
Published: (2025)

LEDOM: Reverse Language Model
by: Yin, Xunjian, et al.
Published: (2025)

Harnessing Rule-Based Reinforcement Learning for Enhanced Grammatical Error Correction
by: Li, Yilin, et al.
Published: (2025)

Defining and Detecting Vulnerability in Human Evaluation Guidelines: A Preliminary Study Towards Reliable NLG Evaluation
by: Ruan, Jie, et al.
Published: (2024)

Large Language Models Are Active Critics in NLG Evaluation
by: Xu, Shuying, et al.
Published: (2024)

EAMA : Entity-Aware Multimodal Alignment Based Approach for News Image Captioning
by: Zhang, Junzhe, et al.
Published: (2024)

MC-MKE: A Fine-Grained Multimodal Knowledge Editing Benchmark Emphasizing Modality Consistency
by: Zhang, Junzhe, et al.
Published: (2024)

CFunModel: A "Funny" Language Model Capable of Chinese Humor Generation and Processing
by: Yu, Zhenghan, et al.
Published: (2025)

Is Reference Necessary in the Evaluation of NLG Systems? When and Where?
by: Sheng, Shuqian, et al.
Published: (2024)

Not All Metrics Are Guilty: Improving NLG Evaluation by Diversifying References
by: Tang, Tianyi, et al.
Published: (2023)

Leveraging Large Language Models for NLG Evaluation: Advances and Challenges
by: Li, Zhen, et al.
Published: (2024)

Re-evaluating Automatic LLM System Ranking for Alignment with Human Preference
by: Gao, Mingqi, et al.
Published: (2024)

SMART-RAG: Selection using Determinantal Matrices for Augmented Retrieval
by: Li, Jiatao, et al.
Published: (2024)

NLG Evaluation: Past, Present, Future
by: Reiter, Ehud
Published: (2026)

Unveiling the Achilles' Heel of NLG Evaluators: A Unified Adversarial Framework Driven by Large Language Models
by: Chen, Yiming, et al.
Published: (2024)

AmbigNLG: Addressing Task Ambiguity in Instruction for NLG
by: Niwa, Ayana, et al.
Published: (2024)

Evaluating, Understanding, and Improving Constrained Text Generation for Large Language Models
by: Chen, Xiang, et al.
Published: (2023)

DHP Benchmark: Are LLMs Good NLG Evaluators?
by: Wang, Yicheng, et al.
Published: (2024)

How to Select Datapoints for Efficient Human Evaluation of NLG Models?
by: Zouhar, Vilém, et al.
Published: (2025)

SCOPE: Intrinsic Semantic Space Control for Mitigating Copyright Infringement in LLMs
by: Zhang, Zhenliang, et al.
Published: (2025)

Exploring Causal Effect of Social Bias on Faithfulness Hallucinations in Large Language Models
by: Zhang, Zhenliang, et al.
Published: (2025)

Understanding the Interplay between Parametric and Contextual Knowledge for Large Language Models
by: Cheng, Sitao, et al.
Published: (2024)

SAGEval: The frontiers of Satisfactory Agent based NLG Evaluation for reference-free open-ended text
by: Ghosh, Reshmi, et al.
Published: (2024)

LLM Comparative Assessment: Zero-shot NLG Evaluation through Pairwise Comparisons using Large Language Models
by: Liusie, Adian, et al.
Published: (2023)

HAD: HAllucination Detection Language Models Based on a Comprehensive Hallucination Taxonomy
by: Xu, Fan, et al.
Published: (2025)

Effectively Prompting Small-sized Language Models for Cross-lingual Tasks via Winning Tickets
by: Li, Mingqi, et al.
Published: (2024)

Beyond One-Size-Fits-All: Inversion Learning for Highly Effective NLG Evaluation Prompts
by: Hong, Hanhua, et al.
Published: (2025)