Cover Image

PairEval: Open-domain Dialogue Evaluation with Pairwise Comparison

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Park, ChaeHun, Choi, Minseok, Lee, Dohyun, Choo, Jaegul
Format:	Preprint
Published:	2024
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Breaking Chains: Unraveling the Links in Multi-Hop Knowledge Unlearning
by: Choi, Minseok, et al.
Published: (2024)

The Comparative Trap: Pairwise Comparisons Amplifies Biased Preferences of LLM Evaluators
by: Jeong, Hawon, et al.
Published: (2024)

Evaluating Automatic Speech Recognition Systems for Korean Meteorological Experts
by: Park, ChaeHun, et al.
Published: (2024)

Can Tool-augmented Large Language Models be Aware of Incomplete Conditions?
by: Yang, Seungbin, et al.
Published: (2024)

Opt-Out: Investigating Entity-Level Unlearning for Large Language Models via Optimal Transport
by: Choi, Minseok, et al.
Published: (2024)

Protecting Privacy Through Approximating Optimal Parameters for Sequence Unlearning in Language Models
by: Lee, Dohyun, et al.
Published: (2024)

LiveWeb-IE: A Benchmark For Online Web Information Extraction
by: Yang, Seungbin, et al.
Published: (2026)

Evaluating Visual and Cultural Interpretation: The K-Viscuit Benchmark with Human-VLM Collaboration
by: Park, ChaeHun, et al.
Published: (2024)

Reward-Weighted Sampling: Enhancing Non-Autoregressive Characteristics in Masked Diffusion LLMs
by: Gwak, Daehoon, et al.
Published: (2025)

Not the Example, but the Process: How Self-Generated Examples Enhance LLM Reasoning
by: Gwak, Daehoon, et al.
Published: (2026)

Cross-Lingual Unlearning of Selective Knowledge in Multilingual Language Models
by: Choi, Minseok, et al.
Published: (2024)

Translation Deserves Better: Analyzing Translation Artifacts in Cross-lingual Visual Question Answering
by: Park, ChaeHun, et al.
Published: (2024)

Exploring In-context Example Generation for Machine Translation
by: Lee, Dohyun, et al.
Published: (2025)

Soda-Eval: Open-Domain Dialogue Evaluation in the age of LLMs
by: Mendonça, John, et al.
Published: (2024)

LEGO-Eval: Towards Fine-Grained Evaluation on Synthesizing 3D Embodied Environments with Tool Augmentation
by: Hwangbo, Gyeom, et al.
Published: (2025)

Forecasting Future International Events: A Reliable Dataset for Text-Based Event Modeling
by: Gwak, Daehoon, et al.
Published: (2024)

ExpGuard: LLM Content Moderation in Specialized Domains
by: Choi, Minseok, et al.
Published: (2026)

BankMathBench: A Benchmark for Numerical Reasoning in Banking Scenarios
by: Lee, Yunseung, et al.
Published: (2026)

Single Ground Truth Is Not Enough: Adding Flexibility to Aspect-Based Sentiment Analysis Evaluation
by: Yang, Soyoung, et al.
Published: (2024)

Def-DTS: Deductive Reasoning for Open-domain Dialogue Topic Segmentation
by: Lee, Seungmin, et al.
Published: (2025)

Enhancing Intrinsic Features for Debiasing via Investigating Class-Discerning Common Attributes in Bias-Contrastive Pair
by: Park, Jeonghoon, et al.
Published: (2024)

From What to Respond to When to Respond: Timely Response Generation for Open-domain Dialogue Agents
by: Jang, Seongbo, et al.
Published: (2025)

Cross-lingual Collapse: How Language-Centric Foundation Models Shape Reasoning in Large Language Models
by: Park, Cheonbok, et al.
Published: (2025)

MultiPragEval: Multilingual Pragmatic Evaluation of Large Language Models
by: Park, Dojun, et al.
Published: (2024)

Building Resource-Constrained Language Agents: A Korean Case Study on Chemical Toxicity Information
by: Cho, Hojun, et al.
Published: (2025)

TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarization
by: Tang, Liyan, et al.
Published: (2024)

Retrieve Only Relevant Tables Whether Few or Many: Adaptive Table Retrieval Method
by: Kim, Taehee, et al.
Published: (2026)

PairUni: Pairwise Training for Unified Multimodal Language Models
by: Zheng, Jiani, et al.
Published: (2025)

ProactiveEval: A Unified Evaluation Framework for Proactive Dialogue Agents
by: Liu, Tianjian, et al.
Published: (2025)

A Knowledge Plug-and-Play Test Bed for Open-domain Dialogue Generation
by: Li, Xiangci, et al.
Published: (2024)

On the Benchmarking of LLMs for Open-Domain Dialogue Evaluation
by: Mendonça, John, et al.
Published: (2024)

Revisiting LLMs as Zero-Shot Time-Series Forecasters: Small Noise Can Break Large Models
by: Park, Junwoo, et al.
Published: (2025)

PairDistill: Pairwise Relevance Distillation for Dense Retrieval
by: Huang, Chao-Wei, et al.
Published: (2024)

Creating a Fine Grained Entity Type Taxonomy Using LLMs
by: Gunn, Michael, et al.
Published: (2024)

Talk to Your Slides: High-Efficiency Slide Editing via Language-Driven Structured Data Manipulation
by: Jung, Kyudan, et al.
Published: (2025)

OpenHuEval: Evaluating Large Language Model on Hungarian Specifics
by: Yang, Haote, et al.
Published: (2025)

GDLNN: Marriage of Programming Language and Neural Networks for Accurate and Easy-to-Explain Graph Classification
by: Jeon, Minseok, et al.
Published: (2025)

Direct-Scoring NLG Evaluators Can Use Pairwise Comparisons Too
by: Lawrence, Logan, et al.
Published: (2025)

SKG-Eval: Stateful Evaluation of Multi-Turn Dialogue via Incremental Semantic Knowledge Graphs
by: Shil, Avijit, et al.
Published: (2026)

LLM Comparative Assessment: Zero-shot NLG Evaluation through Pairwise Comparisons using Large Language Models
by: Liusie, Adian, et al.
Published: (2023)