Clustering of Acoustic Environments with Variational Autoencoders for Hearing Devices

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Fiorio, Luan Vinícius, Nikoloska, Ivana, van Houtum, Wim, Aarts, Ronald M.
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866912836219830272
author Fiorio, Luan Vinícius
Nikoloska, Ivana
van Houtum, Wim
Aarts, Ronald M.
author_facet Fiorio, Luan Vinícius
Nikoloska, Ivana
van Houtum, Wim
Aarts, Ronald M.
contents Traditional acoustic environment classification relies on: i) classical signal processing algorithms, which are unable to extract meaningful representations of high-dimensional data; or on ii) supervised learning, limited by the availability of labels. Knowing that human-imposed labels do not always reflect the true structure of acoustic scenes, we explore the potential of (unsupervised) clustering of acoustic environments using variational autoencoders (VAEs). We employ a VAE model for categorical latent clustering with a Gumbel-Softmax reparameterization which can operate with a time-context windowing scheme for lower memory requirements, tailored for real-world hearing device scenarios. Additionally, general adaptations on VAE architectures for audio clustering are also proposed. The approaches are validated through the clustering of spoken digits, a simpler task where labels are meaningful, and urban soundscapes, where the recordings present strong overlap in time and frequency. While all variational methods succeeded when clustering spoken digits, only the proposed model achieved effective clustering performance on urban acoustic scenes, given its categorical nature.
format Preprint
id arxiv_https___arxiv_org_abs_2510_01940
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Clustering of Acoustic Environments with Variational Autoencoders for Hearing Devices
Fiorio, Luan Vinícius
Nikoloska, Ivana
van Houtum, Wim
Aarts, Ronald M.
Audio and Speech Processing
Traditional acoustic environment classification relies on: i) classical signal processing algorithms, which are unable to extract meaningful representations of high-dimensional data; or on ii) supervised learning, limited by the availability of labels. Knowing that human-imposed labels do not always reflect the true structure of acoustic scenes, we explore the potential of (unsupervised) clustering of acoustic environments using variational autoencoders (VAEs). We employ a VAE model for categorical latent clustering with a Gumbel-Softmax reparameterization which can operate with a time-context windowing scheme for lower memory requirements, tailored for real-world hearing device scenarios. Additionally, general adaptations on VAE architectures for audio clustering are also proposed. The approaches are validated through the clustering of spoken digits, a simpler task where labels are meaningful, and urban soundscapes, where the recordings present strong overlap in time and frequency. While all variational methods succeeded when clustering spoken digits, only the proposed model achieved effective clustering performance on urban acoustic scenes, given its categorical nature.
title Clustering of Acoustic Environments with Variational Autoencoders for Hearing Devices
topic Audio and Speech Processing
url https://arxiv.org/abs/2510.01940