The CHiME-8 DASR Challenge for Generalizable and Array Agnostic Distant Automatic Speech Recognition and Diarization

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Cornell, Samuele, Park, Taejin, Huang, Steve, Boeddeker, Christoph, Chang, Xuankai, Maciejewski, Matthew, Wiesner, Matthew, Garcia, Paola, Watanabe, Shinji
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929432682299392
author Cornell, Samuele
Park, Taejin
Huang, Steve
Boeddeker, Christoph
Chang, Xuankai
Maciejewski, Matthew
Wiesner, Matthew
Garcia, Paola
Watanabe, Shinji
author_facet Cornell, Samuele
Park, Taejin
Huang, Steve
Boeddeker, Christoph
Chang, Xuankai
Maciejewski, Matthew
Wiesner, Matthew
Garcia, Paola
Watanabe, Shinji
contents This paper presents the CHiME-8 DASR challenge which carries on from the previous edition CHiME-7 DASR (C7DASR) and the past CHiME-6 challenge. It focuses on joint multi-channel distant speech recognition (DASR) and diarization with one or more, possibly heterogeneous, devices. The main goal is to spur research towards meeting transcription approaches that can generalize across arbitrary number of speakers, diverse settings (formal vs. informal conversations), meeting duration, wide-variety of acoustic scenarios and different recording configurations. Novelties with respect to C7DASR include: i) the addition of NOTSOFAR-1, an additional office/corporate meeting scenario, ii) a manually corrected Mixer 6 development set, iii) a new track in which we allow the use of large-language models (LLM) iv) a jury award mechanism to encourage participants to explore also more practical and innovative solutions. To lower the entry barrier for participants, we provide a standalone toolkit for downloading and preparing such datasets as well as performing text normalization and scoring their submissions. Furthermore, this year we also provide two baseline systems, one directly inherited from C7DASR and based on ESPnet and another one developed on NeMo and based on NeMo team submission in last year C7DASR. Baseline system results suggest that the addition of the NOTSOFAR-1 scenario significantly increases the task's difficulty due to its high number of speakers and very short duration.
format Preprint
id arxiv_https___arxiv_org_abs_2407_16447
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle The CHiME-8 DASR Challenge for Generalizable and Array Agnostic Distant Automatic Speech Recognition and Diarization
Cornell, Samuele
Park, Taejin
Huang, Steve
Boeddeker, Christoph
Chang, Xuankai
Maciejewski, Matthew
Wiesner, Matthew
Garcia, Paola
Watanabe, Shinji
Audio and Speech Processing
Sound
This paper presents the CHiME-8 DASR challenge which carries on from the previous edition CHiME-7 DASR (C7DASR) and the past CHiME-6 challenge. It focuses on joint multi-channel distant speech recognition (DASR) and diarization with one or more, possibly heterogeneous, devices. The main goal is to spur research towards meeting transcription approaches that can generalize across arbitrary number of speakers, diverse settings (formal vs. informal conversations), meeting duration, wide-variety of acoustic scenarios and different recording configurations. Novelties with respect to C7DASR include: i) the addition of NOTSOFAR-1, an additional office/corporate meeting scenario, ii) a manually corrected Mixer 6 development set, iii) a new track in which we allow the use of large-language models (LLM) iv) a jury award mechanism to encourage participants to explore also more practical and innovative solutions. To lower the entry barrier for participants, we provide a standalone toolkit for downloading and preparing such datasets as well as performing text normalization and scoring their submissions. Furthermore, this year we also provide two baseline systems, one directly inherited from C7DASR and based on ESPnet and another one developed on NeMo and based on NeMo team submission in last year C7DASR. Baseline system results suggest that the addition of the NOTSOFAR-1 scenario significantly increases the task's difficulty due to its high number of speakers and very short duration.
title The CHiME-8 DASR Challenge for Generalizable and Array Agnostic Distant Automatic Speech Recognition and Diarization
topic Audio and Speech Processing
Sound
url https://arxiv.org/abs/2407.16447