Saved in:
Bibliographic Details
Main Authors: Wang, Jiahe, Li, Chenda, Wang, Wei, Zhang, Wangyou, Cornell, Samuele, Sach, Marvin, Scheibler, Robin, Saijo, Kohei, Fu, Yihui, Ni, Zhaoheng, Kumar, Anurag, Fingscheidt, Tim, Watanabe, Shinji, Qian, Yanmin
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2506.23874
Tags: Add Tag
No Tags, Be the first to tag this record!
Table of Contents:
  • The Mean Opinion Score (MOS) is fundamental to speech quality assessment. However, its acquisition requires significant human annotation. Although deep neural network approaches, such as DNSMOS and UTMOS, have been developed to predict MOS to avoid this issue, they often suffer from insufficient training data. Recognizing that the comparison of speech enhancement (SE) systems prioritizes a reliable system comparison over absolute scores, we propose URGENT-PK, a novel ranking approach leveraging pairwise comparisons. URGENT-PK takes homologous enhanced speech pairs as input to predict relative quality rankings. This pairwise paradigm efficiently utilizes limited training data, as all pairwise permutations of multiple systems constitute a training instance. Experiments across multiple open test sets demonstrate URGENT-PK's superior system-level ranking performance over state-of-the-art baselines, despite its simple network architecture and limited training data.