Generative Annotation for ASR Named Entity Correction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Luo, Yuanchang, Wei, Daimeng, Li, Shaojun, Shang, Hengchao, Guo, Jiaxin, Li, Zongyao, Wu, Zhanglin, Chen, Xiaoyu, Rao, Zhiqiang, Yang, Jinlong, Yang, Hao
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914110840504320
author Luo, Yuanchang
Wei, Daimeng
Li, Shaojun
Shang, Hengchao
Guo, Jiaxin
Li, Zongyao
Wu, Zhanglin
Chen, Xiaoyu
Rao, Zhiqiang
Yang, Jinlong
Yang, Hao
author_facet Luo, Yuanchang
Wei, Daimeng
Li, Shaojun
Shang, Hengchao
Guo, Jiaxin
Li, Zongyao
Wu, Zhanglin
Chen, Xiaoyu
Rao, Zhiqiang
Yang, Jinlong
Yang, Hao
contents End-to-end automatic speech recognition systems often fail to transcribe domain-specific named entities, causing catastrophic failures in downstream tasks. Numerous fast and lightweight named entity correction (NEC) models have been proposed in recent years. These models, mainly leveraging phonetic-level edit distance algorithms, have shown impressive performances. However, when the forms of the wrongly-transcribed words(s) and the ground-truth entity are significantly different, these methods often fail to locate the wrongly transcribed words in hypothesis, thus limiting their usage. We propose a novel NEC method that utilizes speech sound features to retrieve candidate entities. With speech sound features and candidate entities, we inovatively design a generative method to annotate entity errors in ASR transcripts and replace the text with correct entities. This method is effective in scenarios of word form difference. We test our method using open-source and self-constructed test sets. The results demonstrate that our NEC method can bring significant improvement to entity accuracy. The self-constructed training data and test set is publicly available at github.com/L6-NLP/Generative-Annotation-NEC.
format Preprint
id arxiv_https___arxiv_org_abs_2508_20700
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Generative Annotation for ASR Named Entity Correction
Luo, Yuanchang
Wei, Daimeng
Li, Shaojun
Shang, Hengchao
Guo, Jiaxin
Li, Zongyao
Wu, Zhanglin
Chen, Xiaoyu
Rao, Zhiqiang
Yang, Jinlong
Yang, Hao
Computation and Language
Artificial Intelligence
End-to-end automatic speech recognition systems often fail to transcribe domain-specific named entities, causing catastrophic failures in downstream tasks. Numerous fast and lightweight named entity correction (NEC) models have been proposed in recent years. These models, mainly leveraging phonetic-level edit distance algorithms, have shown impressive performances. However, when the forms of the wrongly-transcribed words(s) and the ground-truth entity are significantly different, these methods often fail to locate the wrongly transcribed words in hypothesis, thus limiting their usage. We propose a novel NEC method that utilizes speech sound features to retrieve candidate entities. With speech sound features and candidate entities, we inovatively design a generative method to annotate entity errors in ASR transcripts and replace the text with correct entities. This method is effective in scenarios of word form difference. We test our method using open-source and self-constructed test sets. The results demonstrate that our NEC method can bring significant improvement to entity accuracy. The self-constructed training data and test set is publicly available at github.com/L6-NLP/Generative-Annotation-NEC.
title Generative Annotation for ASR Named Entity Correction
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2508.20700