Disentangled Representation Learning for Environment-agnostic Speaker Recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Nam, KiHyun, Heo, Hee-Soo, Jung, Jee-weon, Chung, Joon Son
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910495888375808
author Nam, KiHyun
Heo, Hee-Soo
Jung, Jee-weon
Chung, Joon Son
author_facet Nam, KiHyun
Heo, Hee-Soo
Jung, Jee-weon
Chung, Joon Son
contents This work presents a framework based on feature disentanglement to learn speaker embeddings that are robust to environmental variations. Our framework utilises an auto-encoder as a disentangler, dividing the input speaker embedding into components related to the speaker and other residual information. We employ a group of objective functions to ensure that the auto-encoder's code representation - used as the refined embedding - condenses only the speaker characteristics. We show the versatility of our framework through its compatibility with any existing speaker embedding extractor, requiring no structural modifications or adaptations for integration. We validate the effectiveness of our framework by incorporating it into two popularly used embedding extractors and conducting experiments across various benchmarks. The results show a performance improvement of up to 16%. We release our code for this work to be available https://github.com/kaistmm/voxceleb-disentangler
format Preprint
id arxiv_https___arxiv_org_abs_2406_14559
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Disentangled Representation Learning for Environment-agnostic Speaker Recognition
Nam, KiHyun
Heo, Hee-Soo
Jung, Jee-weon
Chung, Joon Son
Sound
Audio and Speech Processing
This work presents a framework based on feature disentanglement to learn speaker embeddings that are robust to environmental variations. Our framework utilises an auto-encoder as a disentangler, dividing the input speaker embedding into components related to the speaker and other residual information. We employ a group of objective functions to ensure that the auto-encoder's code representation - used as the refined embedding - condenses only the speaker characteristics. We show the versatility of our framework through its compatibility with any existing speaker embedding extractor, requiring no structural modifications or adaptations for integration. We validate the effectiveness of our framework by incorporating it into two popularly used embedding extractors and conducting experiments across various benchmarks. The results show a performance improvement of up to 16%. We release our code for this work to be available https://github.com/kaistmm/voxceleb-disentangler
title Disentangled Representation Learning for Environment-agnostic Speaker Recognition
topic Sound
Audio and Speech Processing
url https://arxiv.org/abs/2406.14559