MultiMed-ST: Large-scale Many-to-many Multilingual Medical Speech Translation

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Le-Duc, Khai, Tran, Tuyen, Tat, Bach Phan, Bui, Nguyen Kim Hai, Dang, Quan, Tran, Hung-Phong, Nguyen, Thanh-Thuy, Nguyen, Ly, Phan, Tuan-Minh, Tran, Thi Thu Phuong, Ngo, Chris, Khanh, Nguyen X., Nguyen-Tang, Thanh
Formato: Preprint
Publicado: 2025
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866915607914479616
author Le-Duc, Khai
Tran, Tuyen
Tat, Bach Phan
Bui, Nguyen Kim Hai
Dang, Quan
Tran, Hung-Phong
Nguyen, Thanh-Thuy
Nguyen, Ly
Phan, Tuan-Minh
Tran, Thi Thu Phuong
Ngo, Chris
Khanh, Nguyen X.
Nguyen-Tang, Thanh
author_facet Le-Duc, Khai
Tran, Tuyen
Tat, Bach Phan
Bui, Nguyen Kim Hai
Dang, Quan
Tran, Hung-Phong
Nguyen, Thanh-Thuy
Nguyen, Ly
Phan, Tuan-Minh
Tran, Thi Thu Phuong
Ngo, Chris
Khanh, Nguyen X.
Nguyen-Tang, Thanh
contents Multilingual speech translation (ST) and machine translation (MT) in the medical domain enhances patient care by enabling efficient communication across language barriers, alleviating specialized workforce shortages, and facilitating improved diagnosis and treatment, particularly during pandemics. In this work, we present the first systematic study on medical ST, to our best knowledge, by releasing MultiMed-ST, a large-scale ST dataset for the medical domain, spanning all translation directions in five languages: Vietnamese, English, German, French, and Simplified/Traditional Chinese, together with the models. With 290,000 samples, this is the largest medical MT dataset and the largest many-to-many multilingual ST among all domains. Secondly, we present the most comprehensive ST analysis in the field's history, to our best knowledge, including: empirical baselines, bilingual-multilingual comparative study, end-to-end vs. cascaded comparative study, task-specific vs. multi-task sequence-to-sequence comparative study, code-switch analysis, and quantitative-qualitative error analysis. All code, data, and models are available online: https://github.com/leduckhai/MultiMed-ST
format Preprint
id arxiv_https___arxiv_org_abs_2504_03546
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MultiMed-ST: Large-scale Many-to-many Multilingual Medical Speech Translation
Le-Duc, Khai
Tran, Tuyen
Tat, Bach Phan
Bui, Nguyen Kim Hai
Dang, Quan
Tran, Hung-Phong
Nguyen, Thanh-Thuy
Nguyen, Ly
Phan, Tuan-Minh
Tran, Thi Thu Phuong
Ngo, Chris
Khanh, Nguyen X.
Nguyen-Tang, Thanh
Computation and Language
Artificial Intelligence
Machine Learning
Sound
Audio and Speech Processing
Multilingual speech translation (ST) and machine translation (MT) in the medical domain enhances patient care by enabling efficient communication across language barriers, alleviating specialized workforce shortages, and facilitating improved diagnosis and treatment, particularly during pandemics. In this work, we present the first systematic study on medical ST, to our best knowledge, by releasing MultiMed-ST, a large-scale ST dataset for the medical domain, spanning all translation directions in five languages: Vietnamese, English, German, French, and Simplified/Traditional Chinese, together with the models. With 290,000 samples, this is the largest medical MT dataset and the largest many-to-many multilingual ST among all domains. Secondly, we present the most comprehensive ST analysis in the field's history, to our best knowledge, including: empirical baselines, bilingual-multilingual comparative study, end-to-end vs. cascaded comparative study, task-specific vs. multi-task sequence-to-sequence comparative study, code-switch analysis, and quantitative-qualitative error analysis. All code, data, and models are available online: https://github.com/leduckhai/MultiMed-ST
title MultiMed-ST: Large-scale Many-to-many Multilingual Medical Speech Translation
topic Computation and Language
Artificial Intelligence
Machine Learning
Sound
Audio and Speech Processing
url https://arxiv.org/abs/2504.03546