Can We Really Repurpose Multi-Speaker ASR Corpus for Speaker Diarization?
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866908501660401664 |
|---|---|
| author | Horiguchi, Shota Tawara, Naohiro Ashihara, Takanori Ando, Atsushi Delcroix, Marc |
| author_facet | Horiguchi, Shota Tawara, Naohiro Ashihara, Takanori Ando, Atsushi Delcroix, Marc |
| contents | Neural speaker diarization is widely used for overlap-aware speaker diarization, but it requires large multi-speaker datasets for training. To meet this data requirement, large datasets are often constructed by combining multiple corpora, including those originally designed for multi-speaker automatic speech recognition (ASR). However, ASR datasets often feature loosely defined segment boundaries that do not align with the stricter conventions of diarization benchmarks. In this work, we show that such boundary looseness significantly impacts the diarization error rate, reducing evaluation reliability. We also reveal that models trained on data with varying boundary precision tend to learn dataset-specific looseness, leading to poor generalization across out-of-domain datasets. Training with standardized tight boundaries via forced alignment improves not only diarization performance, especially in streaming scenarios, but also ASR performance when combined with simple post-processing. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2507_09226 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Can We Really Repurpose Multi-Speaker ASR Corpus for Speaker Diarization? Horiguchi, Shota Tawara, Naohiro Ashihara, Takanori Ando, Atsushi Delcroix, Marc Audio and Speech Processing Sound Neural speaker diarization is widely used for overlap-aware speaker diarization, but it requires large multi-speaker datasets for training. To meet this data requirement, large datasets are often constructed by combining multiple corpora, including those originally designed for multi-speaker automatic speech recognition (ASR). However, ASR datasets often feature loosely defined segment boundaries that do not align with the stricter conventions of diarization benchmarks. In this work, we show that such boundary looseness significantly impacts the diarization error rate, reducing evaluation reliability. We also reveal that models trained on data with varying boundary precision tend to learn dataset-specific looseness, leading to poor generalization across out-of-domain datasets. Training with standardized tight boundaries via forced alignment improves not only diarization performance, especially in streaming scenarios, but also ASR performance when combined with simple post-processing. |
| title | Can We Really Repurpose Multi-Speaker ASR Corpus for Speaker Diarization? |
| topic | Audio and Speech Processing Sound |
| url | https://arxiv.org/abs/2507.09226 |