Utilizing TTS Synthesized Data for Efficient Development of Keyword Spotting Model
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2024
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914306166095872 |
|---|---|
| author | Park, Hyun Jin Agarwal, Dhruuv Chen, Neng Sun, Rentao Partridge, Kurt Chen, Justin Zhang, Harry Zhu, Pai Bartel, Jacob Kastner, Kyle Wang, Gary Rosenberg, Andrew Wang, Quan |
| author_facet | Park, Hyun Jin Agarwal, Dhruuv Chen, Neng Sun, Rentao Partridge, Kurt Chen, Justin Zhang, Harry Zhu, Pai Bartel, Jacob Kastner, Kyle Wang, Gary Rosenberg, Andrew Wang, Quan |
| contents | This paper explores the use of TTS synthesized training data for KWS (keyword spotting) task while minimizing development cost and time. Keyword spotting models require a huge amount of training data to be accurate, and obtaining such training data can be costly. In the current state of the art, TTS models can generate large amounts of natural-sounding data, which can help reducing cost and time for KWS model development. Still, TTS generated data can be lacking diversity compared to real data. To pursue maximizing KWS model accuracy under the constraint of limited resources and current TTS capability, we explored various strategies to mix TTS data and real human speech data, with a focus on minimizing real data use and maximizing diversity of TTS output. Our experimental results indicate that relatively small amounts of real audio data with speaker diversity (100 speakers, 2k utterances) and large amounts of TTS synthesized data can achieve reasonably high accuracy (within 3x error rate of baseline), compared to the baseline (trained with 3.8M real positive utterances). |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_18879 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Utilizing TTS Synthesized Data for Efficient Development of Keyword Spotting Model Park, Hyun Jin Agarwal, Dhruuv Chen, Neng Sun, Rentao Partridge, Kurt Chen, Justin Zhang, Harry Zhu, Pai Bartel, Jacob Kastner, Kyle Wang, Gary Rosenberg, Andrew Wang, Quan Sound Machine Learning Audio and Speech Processing This paper explores the use of TTS synthesized training data for KWS (keyword spotting) task while minimizing development cost and time. Keyword spotting models require a huge amount of training data to be accurate, and obtaining such training data can be costly. In the current state of the art, TTS models can generate large amounts of natural-sounding data, which can help reducing cost and time for KWS model development. Still, TTS generated data can be lacking diversity compared to real data. To pursue maximizing KWS model accuracy under the constraint of limited resources and current TTS capability, we explored various strategies to mix TTS data and real human speech data, with a focus on minimizing real data use and maximizing diversity of TTS output. Our experimental results indicate that relatively small amounts of real audio data with speaker diversity (100 speakers, 2k utterances) and large amounts of TTS synthesized data can achieve reasonably high accuracy (within 3x error rate of baseline), compared to the baseline (trained with 3.8M real positive utterances). |
| title | Utilizing TTS Synthesized Data for Efficient Development of Keyword Spotting Model |
| topic | Sound Machine Learning Audio and Speech Processing |
| url | https://arxiv.org/abs/2407.18879 |