Cover Image

Evaluating Task-oriented Dialogue Systems: A Systematic Review of Measures, Constructs and their Operationalisations

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Braggaar, Anouck, Liebrecht, Christine, van Miltenburg, Emiel, Krahmer, Emiel
Format:	Preprint
Published:	2023
Subjects:	Computation and Language Human-Computer Interaction
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Dual use issues in the field of Natural Language Generation
by: van Miltenburg, Emiel
Published: (2025)

Image captioning in different languages
by: van Miltenburg, Emiel
Published: (2024)

Natural Language Generation
by: van Miltenburg, Emiel, et al.
Published: (2025)

A Systematic Review on the Evaluation of Large Language Models in Theory of Mind Tasks
by: Sarıtaş, Karahan, et al.
Published: (2025)

IP-Dialog: Evaluating Implicit Personalization in Dialogue Systems with Synthetic Data
by: Peng, Bo, et al.
Published: (2025)

Context Does Matter: Implications for Crowdsourced Evaluation Labels in Task-Oriented Dialogue Systems
by: Siro, Clemencia, et al.
Published: (2024)

A Methodology for Identifying Evaluation Items for Practical Dialogue Systems Based on Business-Dialogue System Alignment Models
by: Nakano, Mikio, et al.
Published: (2026)

Can we use LLMs to bootstrap reinforcement learning? -- A case study in digital health behavior change
by: Albers, Nele, et al.
Published: (2025)

FlexDuo: A Pluggable System for Enabling Full-Duplex Capabilities in Speech Dialogue Systems
by: Liao, Borui, et al.
Published: (2025)

PsyChat: A Client-Centric Dialogue System for Mental Health Support
by: Qiu, Huachuan, et al.
Published: (2023)

Learning from Implicit User Feedback, Emotions and Demographic Information in Task-Oriented and Document-Grounded Dialogues
by: Petrak, Dominic, et al.
Published: (2024)

Bridging Reasoning and Action: Hybrid LLM-RL Framework for Efficient Cross-Domain Task-Oriented Dialogue
by: Zhao, Yangyang, et al.
Published: (2026)

An Analysis of User Behaviors for Objectively Evaluating Spoken Dialogue Systems
by: Inoue, Koji, et al.
Published: (2024)

Collaborative Evaluation of Deepfake Text with Deliberation-Enhancing Dialogue Systems
by: Lee, Jooyoung, et al.
Published: (2025)

Unit-Based Agent for Semi-Cascaded Full-Duplex Dialogue Systems
by: Yu, Haoyuan, et al.
Published: (2026)

Toward Automated Qualitative Analysis: Leveraging Large Language Models for Tutoring Dialogue Evaluation
by: Gu, Megan, et al.
Published: (2025)

Better Slow than Sorry: Introducing Positive Friction for Reliable Dialogue Systems
by: İnan, Mert, et al.
Published: (2025)

PersoDPO: Scalable Preference Optimization for Instruction-Adherent, Persona-Grounded Dialogue via Multi-LLM Evaluation
by: Afzoon, Saleh, et al.
Published: (2026)

Completing A Systematic Review in Hours instead of Months with Interactive AI Agents
by: Qiu, Rui, et al.
Published: (2025)

Exploring ReAct Prompting for Task-Oriented Dialogue: Insights and Shortcomings
by: Elizabeth, Michelle, et al.
Published: (2024)

Large Language Model Psychometrics: A Systematic Review of Evaluation, Validation, and Enhancement
by: Ye, Haoran, et al.
Published: (2025)

A Systematic Review on Prompt Engineering in Large Language Models for K-12 STEM Education
by: Chen, Eason, et al.
Published: (2024)

BLADE: Better Language Answers through Dialogue and Explanations
by: Jayaweera, Chathuri, et al.
Published: (2026)

Evaluating Large Language Models in Analysing Classroom Dialogue
by: Long, Yun, et al.
Published: (2024)

ProactiveEval: A Unified Evaluation Framework for Proactive Dialogue Agents
by: Liu, Tianjian, et al.
Published: (2025)

Dialogue Language Model with Large-Scale Persona Data Engineering
by: Hong, Mengze, et al.
Published: (2024)

Improving Multi-Domain Task-Oriented Dialogue System with Offline Reinforcement Learning
by: Prajapat, Dharmendra, et al.
Published: (2024)

A concrete example of inclusive design: deaf-oriented accessibility
by: Bianchini, Claudia S., et al.
Published: (2019)

Learning Through Dialogue: Engagement and Efficacy Matter More Than Explanations
by: Furniturewala, Shaz, et al.
Published: (2026)

Multi-Intent Recognition in Dialogue Understanding: A Comparison Between Smaller Open-Source LLMs
by: Ahmad, Adnan, et al.
Published: (2025)

BEYOND DIALOGUE: A Profile-Dialogue Alignment Framework Towards General Role-Playing Language Model
by: Yu, Yeyong, et al.
Published: (2024)

Improving Factuality for Dialogue Response Generation via Graph-Based Knowledge Augmentation
by: Chen, Xiangyan, et al.
Published: (2025)

Towards Stable and Personalised Profiles for Lexical Alignment in Spoken Human-Agent Dialogue
by: Schaaij, Keara, et al.
Published: (2025)

Crisp: Cognitive Restructuring of Negative Thoughts through Multi-turn Supportive Dialogues
by: Zhou, Jinfeng, et al.
Published: (2025)

The Dynamics of Delusion: Modeling Bidirectional False Belief Amplification in Human-Chatbot Dialogue
by: Mehta, Ashish, et al.
Published: (2026)

Creating and Evaluating Personas Using Generative AI: A Scoping Review of 81 Articles
by: Amin, Danial, et al.
Published: (2025)

An Analysis of Dialogue Repair in Voice Assistants
by: Galbraith, Matthew
Published: (2023)

Using Contextually Aligned Online Reviews to Measure LLMs' Performance Disparities Across Language Varieties
by: Tang, Zixin, et al.
Published: (2025)

Evaluating Behavioral Alignment in Conflict Dialogue: A Multi-Dimensional Comparison of LLM Agents and Humans
by: Kwon, Deuksin, et al.
Published: (2025)

Evaluating LLM Adaptation to Sociodemographic Factors: User Profile vs. Dialogue History
by: Zhong, Qishuai, et al.
Published: (2025)