Dial HEALTHDIAL for Advice: A Multilingual and Multi-Parallel Spoken Dialogue Dataset for Knowledge-Grounded Information Seeking

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Hu, Songbo, Liu, Yinhong, Zhou, Ej, Razumovskaia, Evgeniia, Wang, Xiaobin, Fraser, Alexander, Vulić, Ivan, Korhonen, Anna
Formato: Preprint
Publicado: 2026
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866911728538746880
author Hu, Songbo
Liu, Yinhong
Zhou, Ej
Razumovskaia, Evgeniia
Wang, Xiaobin
Fraser, Alexander
Vulić, Ivan
Korhonen, Anna
author_facet Hu, Songbo
Liu, Yinhong
Zhou, Ej
Razumovskaia, Evgeniia
Wang, Xiaobin
Fraser, Alexander
Vulić, Ivan
Korhonen, Anna
contents Creating spoken dialogue datasets is methodologically challenging, and these challenges are amplified when the goal is to build multilingual, multi-parallel datasets at scale. This work introduces HEALTHDIAL, a large-scale, multilingual, and multi-parallel dataset for developing and evaluating retrieval-augmented generation (RAG)-based spoken dialogue systems. The dataset comprises 6,000 information-seeking dialogues (1,500 per language) grounded in trusted content from the World Health Organization (WHO) and 163 hours of user speech recorded from native speakers of diverse dialects across four official WHO languages: Arabic, Chinese, English, and Spanish. Each speaker is annotated with demographic (e.g., gender, age) and sociolinguistic (e.g., primary language, region of origin) variables. We report benchmark results across key dialogue tasks, which reveal consistent performance disparities across languages, even among high-resource ones. To support future research, we release the dataset, a prototype system, and a toolkit for data collection and system evaluation.
format Preprint
id arxiv_https___arxiv_org_abs_2605_30107
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Dial HEALTHDIAL for Advice: A Multilingual and Multi-Parallel Spoken Dialogue Dataset for Knowledge-Grounded Information Seeking
Hu, Songbo
Liu, Yinhong
Zhou, Ej
Razumovskaia, Evgeniia
Wang, Xiaobin
Fraser, Alexander
Vulić, Ivan
Korhonen, Anna
Computation and Language
Creating spoken dialogue datasets is methodologically challenging, and these challenges are amplified when the goal is to build multilingual, multi-parallel datasets at scale. This work introduces HEALTHDIAL, a large-scale, multilingual, and multi-parallel dataset for developing and evaluating retrieval-augmented generation (RAG)-based spoken dialogue systems. The dataset comprises 6,000 information-seeking dialogues (1,500 per language) grounded in trusted content from the World Health Organization (WHO) and 163 hours of user speech recorded from native speakers of diverse dialects across four official WHO languages: Arabic, Chinese, English, and Spanish. Each speaker is annotated with demographic (e.g., gender, age) and sociolinguistic (e.g., primary language, region of origin) variables. We report benchmark results across key dialogue tasks, which reveal consistent performance disparities across languages, even among high-resource ones. To support future research, we release the dataset, a prototype system, and a toolkit for data collection and system evaluation.
title Dial HEALTHDIAL for Advice: A Multilingual and Multi-Parallel Spoken Dialogue Dataset for Knowledge-Grounded Information Seeking
topic Computation and Language
url https://arxiv.org/abs/2605.30107