Salvato in:
| Autori principali: | , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | https://arxiv.org/abs/2604.15929 |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866909053717839872 |
|---|---|
| author | Sinhamahapatra, Supriti Nguyen, Thai-Binh Oğuz, Yiğit Ugan, Enes Niehues, Jan Waibel, Alexander |
| author_facet | Sinhamahapatra, Supriti Nguyen, Thai-Binh Oğuz, Yiğit Ugan, Enes Niehues, Jan Waibel, Alexander |
| contents | The goal of multilingual speech technology is to facilitate seamless communication between individuals speaking different languages, creating the experience as though everyone were a multilingual speaker. To create this experience, speech technology needs to address several challenges: Handling mixed multilingual input, specific vocabulary, and code-switching. However, there is currently no dataset benchmarking this situation. We propose a new benchmark to evaluate current Automatic Speech Recognition (ASR) systems, whether they are able to handle these challenges. The benchmark consists of bilingual discussions on scientific papers between multiple speakers, each conversing in a different language. We provide a standard evaluation framework, beyond Word Error Rate (WER) enabling consistent comparison of ASR performance across languages. Experimental results demonstrate that the proposed dataset is still an open challenge for state-of-the-art ASR systems. The dataset is available in https://huggingface.co/datasets/goodpiku/muscat-eval.
Keywords: multilingual, speech recognition, audio segmentation, speaker diarization |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_15929 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | MUSCAT: MUltilingual, SCientific ConversATion Benchmark Sinhamahapatra, Supriti Nguyen, Thai-Binh Oğuz, Yiğit Ugan, Enes Niehues, Jan Waibel, Alexander Computation and Language The goal of multilingual speech technology is to facilitate seamless communication between individuals speaking different languages, creating the experience as though everyone were a multilingual speaker. To create this experience, speech technology needs to address several challenges: Handling mixed multilingual input, specific vocabulary, and code-switching. However, there is currently no dataset benchmarking this situation. We propose a new benchmark to evaluate current Automatic Speech Recognition (ASR) systems, whether they are able to handle these challenges. The benchmark consists of bilingual discussions on scientific papers between multiple speakers, each conversing in a different language. We provide a standard evaluation framework, beyond Word Error Rate (WER) enabling consistent comparison of ASR performance across languages. Experimental results demonstrate that the proposed dataset is still an open challenge for state-of-the-art ASR systems. The dataset is available in https://huggingface.co/datasets/goodpiku/muscat-eval. Keywords: multilingual, speech recognition, audio segmentation, speaker diarization |
| title | MUSCAT: MUltilingual, SCientific ConversATion Benchmark |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2604.15929 |