Saved in:
| Main Authors: | , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.12675 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910971847507968 |
|---|---|
| author | Kibria, Imran E Williamson, Donald S. |
| author_facet | Kibria, Imran E Williamson, Donald S. |
| contents | Research in modeling subjective metrics for quality assessment has led to the development of no-reference speech models that directly operate on utterance waveforms to predict the Mean Opinion Score (MOS). These models often rely on convolutional layers for local feature extraction and embeddings from impractically large pretrained networks to enhance generalization. We propose an attention-only model based on Swin transformer and standard transformer layers to extract local context features and global utterance features, respectively. The self-attention operator excels at processing sequences, and our lightweight design enhances generalization on limited MOS datasets while improving real-world applicability. We train our network using a sequential self-teaching strategy to improve generalization on MOS labels affected by noise in listener ratings. Experiments on three datasets confirm the effectiveness of our design and demonstrate improvement over baseline models. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_12675 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | AttentiveMOS: A Lightweight Attention-Only Model for Speech Quality Prediction Kibria, Imran E Williamson, Donald S. Audio and Speech Processing Research in modeling subjective metrics for quality assessment has led to the development of no-reference speech models that directly operate on utterance waveforms to predict the Mean Opinion Score (MOS). These models often rely on convolutional layers for local feature extraction and embeddings from impractically large pretrained networks to enhance generalization. We propose an attention-only model based on Swin transformer and standard transformer layers to extract local context features and global utterance features, respectively. The self-attention operator excels at processing sequences, and our lightweight design enhances generalization on limited MOS datasets while improving real-world applicability. We train our network using a sequential self-teaching strategy to improve generalization on MOS labels affected by noise in listener ratings. Experiments on three datasets confirm the effectiveness of our design and demonstrate improvement over baseline models. |
| title | AttentiveMOS: A Lightweight Attention-Only Model for Speech Quality Prediction |
| topic | Audio and Speech Processing |
| url | https://arxiv.org/abs/2410.12675 |