Image de couverture de livre

MADial-Bench: Towards Real-world Evaluation of Memory-Augmented Dialogue Generation

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	He, Junqing, Zhu, Liang, Wang, Rui, Wang, Xi, Haffari, Reza, Zhang, Jiaxing
Format:	Preprint
Publié:	2024
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

MARS-Bench: A Multi-turn Athletic Real-world Scenario Benchmark for Dialogue Evaluation
par: Yang, Chenghao, et autres
Publié: (2025)

Reinforcing Real-world Service Agents: Balancing Utility and Cost in Task-oriented Dialogue
par: Gao, Ning, et autres
Publié: (2026)

AlpsBench: An LLM Personalization Benchmark for Real-Dialogue Memorization and Preference Alignment
par: Xiao, Jianfei, et autres
Publié: (2026)

SciRerankBench: Benchmarking Rerankers Towards Scientific Retrieval-Augmented Generated LLMs
par: Chen, Haotian, et autres
Publié: (2025)

DialogBench: Evaluating LLMs as Human-like Dialogue Systems
par: Ou, Jiao, et autres
Publié: (2023)

VitaBench: Benchmarking LLM Agents with Versatile Interactive Tasks in Real-world Applications
par: He, Wei, et autres
Publié: (2025)

MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agents
par: Tan, Haoran, et autres
Publié: (2025)

MTalk-Bench: Evaluating Speech-to-Speech Models in Multi-Turn Dialogues via Arena-style and Rubrics Protocols
par: Du, Yuhao, et autres
Publié: (2025)

UniMS-RAG: A Unified Multi-source Retrieval-Augmented Generation for Personalized Dialogue Systems
par: Wang, Hongru, et autres
Publié: (2024)

FedDTRE: Federated Dialogue Generation Models Powered by Trustworthiness Evaluation
par: Lu, Shule, et autres
Publié: (2025)

Evaluating Bias in Spoken Dialogue LLMs for Real-World Decisions and Recommendations
par: Wu, Yihao, et autres
Publié: (2025)

Learning Retrieval Augmentation for Personalized Dialogue Generation
par: Huang, Qiushi, et autres
Publié: (2024)

Assistive Large Language Model Agents for Socially-Aware Negotiation Dialogues
par: Hua, Yuncheng, et autres
Publié: (2024)

Recursively Summarizing Enables Long-Term Dialogue Memory in Large Language Models
par: Wang, Qingyue, et autres
Publié: (2023)

StratMem-Bench: Evaluating Strategic Memory Use in Virtual Character Conversation Beyond Factual Recall
par: Wu, Yerong, et autres
Publié: (2026)

ComRAG: Retrieval-Augmented Generation with Dynamic Vector Stores for Real-time Community Question Answering in Industry
par: Chen, Qinwen, et autres
Publié: (2025)

Never Lost in the Middle: Mastering Long-Context Question Answering with Position-Agnostic Decompositional Training
par: He, Junqing, et autres
Publié: (2023)

MemoryRewardBench: Benchmarking Reward Models for Long-Term Memory Management in Large Language Models
par: Tang, Zecheng, et autres
Publié: (2026)

InfoMosaic-Bench: Evaluating Multi-Source Information Seeking in Tool-Augmented Agents
par: Du, Yaxin, et autres
Publié: (2025)

AncientBench: Towards Comprehensive Evaluation on Excavated and Transmitted Chinese Corpora
par: Zhou, Zhihan, et autres
Publié: (2025)

GraphRAG-Bench: Challenging Domain-Specific Reasoning for Evaluating Graph Retrieval-Augmented Generation
par: Xiao, Yilin, et autres
Publié: (2025)

SafeDialBench: A Fine-Grained Safety Evaluation Benchmark for Large Language Models in Multi-Turn Dialogues with Diverse Jailbreak Attacks
par: Cao, Hongye, et autres
Publié: (2025)

Evaluating Long-Horizon Memory for Multi-Party Collaborative Dialogues
par: Hu, Chuanrui, et autres
Publié: (2026)

"In Dialogues We Learn": Towards Personalized Dialogue Without Pre-defined Profiles through In-Dialogue Learning
par: Cheng, Chuanqi, et autres
Publié: (2024)

RealFactBench: A Benchmark for Evaluating Large Language Models in Real-World Fact-Checking
par: Yang, Shuo, et autres
Publié: (2025)

OP-Bench: Benchmarking Over-Personalization for Memory-Augmented Personalized Conversational Agents
par: Hu, Yulin, et autres
Publié: (2026)

MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialogues
par: Bai, Ge, et autres
Publié: (2024)

DiaHalu: A Dialogue-level Hallucination Evaluation Benchmark for Large Language Models
par: Chen, Kedi, et autres
Publié: (2024)

Connecting the Dots: Benchmarking Reflective Memory in Long-Horizon Dialogue
par: Lin, Jingjie, et autres
Publié: (2026)

Toward Faithful Retrieval-Augmented Generation with Sparse Autoencoders
par: Xiong, Guangzhi, et autres
Publié: (2025)

Generating Leakage-Free Benchmarks for Robust RAG Evaluation
par: Liu, Jiayi, et autres
Publié: (2026)

Towards Automatic Evaluation of Task-Oriented Dialogue Flows
par: Mirtaheri, Mehrnoosh, et autres
Publié: (2024)

Emotional Support with LLM-based Empathetic Dialogue Generation
par: Wang, Shiquan, et autres
Publié: (2025)

Enhancing Personalized Multi-Turn Dialogue with Curiosity Reward
par: Wan, Yanming, et autres
Publié: (2025)

MTMCS-Bench: Evaluating Contextual Safety of Multimodal Large Language Models in Multi-Turn Dialogues
par: Liu, Zheyuan, et autres
Publié: (2026)

GEM-RAG: Graphical Eigen Memories For Retrieval Augmented Generation
par: Rappazzo, Brendan Hogan, et autres
Publié: (2024)

GFM-RAG: Graph Foundation Model for Retrieval Augmented Generation
par: Luo, Linhao, et autres
Publié: (2025)

A Static and Dynamic Attention Framework for Multi Turn Dialogue Generation
par: Zhang, Wei-Nan, et autres
Publié: (2024)

DeceptionBench: A Comprehensive Benchmark for AI Deception Behaviors in Real-world Scenarios
par: Huang, Yao, et autres
Publié: (2025)

R-Debater: Retrieval-Augmented Debate Generation through Argumentative Memory
par: Li, Maoyuan, et autres
Publié: (2025)