The USTC-NERCSLIP Systems for The ICMC-ASR Challenge
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866909238925721600 |
|---|---|
| author | Wu, Minghui Xu, Luzhen Zhang, Jie Tang, Haitao Yue, Yanyan Liao, Ruizhi Zhao, Jintao Zhang, Zhengzhe Wang, Yichi Yan, Haoyin Yu, Hongliang Ma, Tongle Liu, Jiachen Wu, Chongliang Li, Yongchao Zhang, Yanyong Fang, Xin Zhang, Yue |
| author_facet | Wu, Minghui Xu, Luzhen Zhang, Jie Tang, Haitao Yue, Yanyan Liao, Ruizhi Zhao, Jintao Zhang, Zhengzhe Wang, Yichi Yan, Haoyin Yu, Hongliang Ma, Tongle Liu, Jiachen Wu, Chongliang Li, Yongchao Zhang, Yanyong Fang, Xin Zhang, Yue |
| contents | This report describes the submitted system to the In-Car Multi-Channel Automatic Speech Recognition (ICMC-ASR) challenge, which considers the ASR task with multi-speaker overlapping and Mandarin accent dynamics in the ICMC case. We implement the front-end speaker diarization using the self-supervised learning representation based multi-speaker embedding and beamforming using the speaker position, respectively. For ASR, we employ an iterative pseudo-label generation method based on fusion model to obtain text labels of unsupervised data. To mitigate the impact of accent, an Accent-ASR framework is proposed, which captures pronunciation-related accent features at a fine-grained level and linguistic information at a coarse-grained level. On the ICMC-ASR eval set, the proposed system achieves a CER of 13.16% on track 1 and a cpCER of 21.48% on track 2, which significantly outperforms the official baseline system and obtains the first rank on both tracks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_02052 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | The USTC-NERCSLIP Systems for The ICMC-ASR Challenge Wu, Minghui Xu, Luzhen Zhang, Jie Tang, Haitao Yue, Yanyan Liao, Ruizhi Zhao, Jintao Zhang, Zhengzhe Wang, Yichi Yan, Haoyin Yu, Hongliang Ma, Tongle Liu, Jiachen Wu, Chongliang Li, Yongchao Zhang, Yanyong Fang, Xin Zhang, Yue Audio and Speech Processing Sound This report describes the submitted system to the In-Car Multi-Channel Automatic Speech Recognition (ICMC-ASR) challenge, which considers the ASR task with multi-speaker overlapping and Mandarin accent dynamics in the ICMC case. We implement the front-end speaker diarization using the self-supervised learning representation based multi-speaker embedding and beamforming using the speaker position, respectively. For ASR, we employ an iterative pseudo-label generation method based on fusion model to obtain text labels of unsupervised data. To mitigate the impact of accent, an Accent-ASR framework is proposed, which captures pronunciation-related accent features at a fine-grained level and linguistic information at a coarse-grained level. On the ICMC-ASR eval set, the proposed system achieves a CER of 13.16% on track 1 and a cpCER of 21.48% on track 2, which significantly outperforms the official baseline system and obtains the first rank on both tracks. |
| title | The USTC-NERCSLIP Systems for The ICMC-ASR Challenge |
| topic | Audio and Speech Processing Sound |
| url | https://arxiv.org/abs/2407.02052 |