Salvato in:
Dettagli Bibliografici
Autori principali: Zhou, Shilin, Li, Zhenghua, Hong, Yu, Zhang, Min, Wang, Zhefeng, Huai, Baoxing
Natura: Preprint
Pubblicazione: 2023
Soggetti:
Accesso online:https://arxiv.org/abs/2305.12839
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909210583760896
author Zhou, Shilin
Li, Zhenghua
Hong, Yu
Zhang, Min
Wang, Zhefeng
Huai, Baoxing
author_facet Zhou, Shilin
Li, Zhenghua
Hong, Yu
Zhang, Min
Wang, Zhefeng
Huai, Baoxing
contents End-to-end automatic speech recognition (ASR) systems have made significant progress in general scenarios. However, it remains challenging to transcribe contextual named entities (NEs) in the contextual ASR scenario. Previous approaches have attempted to address this by utilizing the NE dictionary. These approaches treat entities as individual tokens and generate them token-by-token, which may result in incomplete transcriptions of entities. In this paper, we treat entities as indivisible wholes and introduce the idea of copying into ASR. We design a systematic mechanism called CopyNE, which can copy entities from the NE dictionary. By copying all tokens of an entity at once, we can reduce errors during entity transcription, ensuring the completeness of the entity. Experiments demonstrate that CopyNE consistently improves the accuracy of transcribing entities compared to previous approaches. Even when based on the strong Whisper, CopyNE still achieves notable improvements.
format Preprint
id arxiv_https___arxiv_org_abs_2305_12839
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle CopyNE: Better Contextual ASR by Copying Named Entities
Zhou, Shilin
Li, Zhenghua
Hong, Yu
Zhang, Min
Wang, Zhefeng
Huai, Baoxing
Computation and Language
End-to-end automatic speech recognition (ASR) systems have made significant progress in general scenarios. However, it remains challenging to transcribe contextual named entities (NEs) in the contextual ASR scenario. Previous approaches have attempted to address this by utilizing the NE dictionary. These approaches treat entities as individual tokens and generate them token-by-token, which may result in incomplete transcriptions of entities. In this paper, we treat entities as indivisible wholes and introduce the idea of copying into ASR. We design a systematic mechanism called CopyNE, which can copy entities from the NE dictionary. By copying all tokens of an entity at once, we can reduce errors during entity transcription, ensuring the completeness of the entity. Experiments demonstrate that CopyNE consistently improves the accuracy of transcribing entities compared to previous approaches. Even when based on the strong Whisper, CopyNE still achieves notable improvements.
title CopyNE: Better Contextual ASR by Copying Named Entities
topic Computation and Language
url https://arxiv.org/abs/2305.12839