A Stage-Wise Learning Strategy with Fixed Anchors for Robust Speaker Verification

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Gu, Bin, Dai, Lipeng, Du, Huipeng, Zhao, Haitao, Wei, Jibo
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866915736563220480
author Gu, Bin
Dai, Lipeng
Du, Huipeng
Zhao, Haitao
Wei, Jibo
author_facet Gu, Bin
Dai, Lipeng
Du, Huipeng
Zhao, Haitao
Wei, Jibo
contents Learning robust speaker representations under noisy conditions presents significant challenges, which requires careful handling of both discriminative and noise-invariant properties. In this work, we proposed an anchor-based stage-wise learning strategy for robust speaker representation learning. Specifically, our approach begins by training a base model to establish discriminative speaker boundaries, and then extract anchor embeddings from this model as stable references. Finally, a copy of the base model is fine-tuned on noisy inputs, regularized by enforcing proximity to their corresponding fixed anchor embeddings to preserve speaker identity under distortion. Experimental results suggest that this strategy offers advantages over conventional joint optimization, particularly in maintaining discrimination while improving noise robustness. The proposed method demonstrates consistent improvements across various noise conditions, potentially due to its ability to handle boundary stabilization and variation suppression separately.
format Preprint
id arxiv_https___arxiv_org_abs_2510_18530
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A Stage-Wise Learning Strategy with Fixed Anchors for Robust Speaker Verification
Gu, Bin
Dai, Lipeng
Du, Huipeng
Zhao, Haitao
Wei, Jibo
Sound
Audio and Speech Processing
Learning robust speaker representations under noisy conditions presents significant challenges, which requires careful handling of both discriminative and noise-invariant properties. In this work, we proposed an anchor-based stage-wise learning strategy for robust speaker representation learning. Specifically, our approach begins by training a base model to establish discriminative speaker boundaries, and then extract anchor embeddings from this model as stable references. Finally, a copy of the base model is fine-tuned on noisy inputs, regularized by enforcing proximity to their corresponding fixed anchor embeddings to preserve speaker identity under distortion. Experimental results suggest that this strategy offers advantages over conventional joint optimization, particularly in maintaining discrimination while improving noise robustness. The proposed method demonstrates consistent improvements across various noise conditions, potentially due to its ability to handle boundary stabilization and variation suppression separately.
title A Stage-Wise Learning Strategy with Fixed Anchors for Robust Speaker Verification
topic Sound
Audio and Speech Processing
url https://arxiv.org/abs/2510.18530