SECP: A Speech Enhancement-Based Curation Pipeline For Scalable Acquisition Of Clean Speech
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914685828202496 |
|---|---|
| author | Sabra, Adam Wronka, Cyprian Mao, Michelle Hijazi, Samer |
| author_facet | Sabra, Adam Wronka, Cyprian Mao, Michelle Hijazi, Samer |
| contents | As more speech technologies rely on a supervised deep learning approach with clean speech as the ground truth, a methodology to onboard said speech at scale is needed. However, this approach needs to minimize the dependency on human listening and annotation, only requiring a human-in-the-loop when needed. In this paper, we address this issue by outlining Speech Enhancement-based Curation Pipeline (SECP) which serves as a framework to onboard clean speech. This clean speech can then train a speech enhancement model, which can further refine the original dataset and thus close the iterative loop. By running two iterative rounds, we observe that enhanced output used as ground truth does not degrade model performance according to $Δ_{PESQ}$, a metric used in this paper. We also show through comparative mean opinion score (CMOS) based subjective tests that the highest and lowest bound of refined data is perceptually better than the original data. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2402_12482 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | SECP: A Speech Enhancement-Based Curation Pipeline For Scalable Acquisition Of Clean Speech Sabra, Adam Wronka, Cyprian Mao, Michelle Hijazi, Samer Sound Information Retrieval Machine Learning Audio and Speech Processing As more speech technologies rely on a supervised deep learning approach with clean speech as the ground truth, a methodology to onboard said speech at scale is needed. However, this approach needs to minimize the dependency on human listening and annotation, only requiring a human-in-the-loop when needed. In this paper, we address this issue by outlining Speech Enhancement-based Curation Pipeline (SECP) which serves as a framework to onboard clean speech. This clean speech can then train a speech enhancement model, which can further refine the original dataset and thus close the iterative loop. By running two iterative rounds, we observe that enhanced output used as ground truth does not degrade model performance according to $Δ_{PESQ}$, a metric used in this paper. We also show through comparative mean opinion score (CMOS) based subjective tests that the highest and lowest bound of refined data is perceptually better than the original data. |
| title | SECP: A Speech Enhancement-Based Curation Pipeline For Scalable Acquisition Of Clean Speech |
| topic | Sound Information Retrieval Machine Learning Audio and Speech Processing |
| url | https://arxiv.org/abs/2402.12482 |