Improving Synthetic Data Training for Contextual Biasing Models with a Keyword-Aware Cost Function
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915489382400000 |
|---|---|
| author | Kwok, Chin Yuen Yip, Jia Qi Chng, Eng Siong |
| author_facet | Kwok, Chin Yuen Yip, Jia Qi Chng, Eng Siong |
| contents | Rare word recognition can be improved by adapting ASR models to synthetic data that includes these words. Further improvements can be achieved through contextual biasing, which trains and adds a biasing module into the model architecture to prioritize rare words. While training the module on synthetic rare word data is more effective than using non-rare-word data, it can lead to overfitting due to artifacts in the synthetic audio. To address this, we enhance the TCPGen-based contextual biasing approach and propose a keyword-aware loss function that additionally focuses on biased words when training biasing modules. This loss includes a masked cross-entropy term for biased word prediction and a binary classification term for detecting biased word positions. These two terms complementarily support the decoding of biased words during inference. By adapting Whisper to 10 hours of synthetic data, our method reduced the word error rate on the NSC Part 2 test set from 29.71% to 11.81%. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2509_09197 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Improving Synthetic Data Training for Contextual Biasing Models with a Keyword-Aware Cost Function Kwok, Chin Yuen Yip, Jia Qi Chng, Eng Siong Computation and Language Artificial Intelligence Rare word recognition can be improved by adapting ASR models to synthetic data that includes these words. Further improvements can be achieved through contextual biasing, which trains and adds a biasing module into the model architecture to prioritize rare words. While training the module on synthetic rare word data is more effective than using non-rare-word data, it can lead to overfitting due to artifacts in the synthetic audio. To address this, we enhance the TCPGen-based contextual biasing approach and propose a keyword-aware loss function that additionally focuses on biased words when training biasing modules. This loss includes a masked cross-entropy term for biased word prediction and a binary classification term for detecting biased word positions. These two terms complementarily support the decoding of biased words during inference. By adapting Whisper to 10 hours of synthetic data, our method reduced the word error rate on the NSC Part 2 test set from 29.71% to 11.81%. |
| title | Improving Synthetic Data Training for Contextual Biasing Models with a Keyword-Aware Cost Function |
| topic | Computation and Language Artificial Intelligence |
| url | https://arxiv.org/abs/2509.09197 |