HRTF Estimation using a Score-based Prior

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Thuillier, Etienne, Lemercier, Jean-Marie, Moliner, Eloi, Gerkmann, Timo, Välimäki, Vesa
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913527176888320
author Thuillier, Etienne
Lemercier, Jean-Marie
Moliner, Eloi
Gerkmann, Timo
Välimäki, Vesa
author_facet Thuillier, Etienne
Lemercier, Jean-Marie
Moliner, Eloi
Gerkmann, Timo
Välimäki, Vesa
contents We present a head-related transfer function (HRTF) estimation method which relies on a data-driven prior given by a score-based diffusion model. The HRTF is estimated in reverberant environments using natural excitation signals, e.g. human speech. The impulse response of the room is estimated along with the HRTF by optimizing a parametric model of reverberation based on the statistical behaviour of room acoustics. The posterior distribution of HRTF given the reverberant measurement and excitation signal is modelled using the score-based HRTF prior and a log-likelihood approximation. We show that the resulting method outperforms several baselines, including an oracle recommender system that assigns the optimal HRTF in our training set based on the smallest distance to the true HRTF at the given direction of arrival. In particular, we show that the diffusion prior can account for the large variability of high-frequency content in HRTFs.
format Preprint
id arxiv_https___arxiv_org_abs_2410_01562
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle HRTF Estimation using a Score-based Prior
Thuillier, Etienne
Lemercier, Jean-Marie
Moliner, Eloi
Gerkmann, Timo
Välimäki, Vesa
Audio and Speech Processing
Machine Learning
Sound
We present a head-related transfer function (HRTF) estimation method which relies on a data-driven prior given by a score-based diffusion model. The HRTF is estimated in reverberant environments using natural excitation signals, e.g. human speech. The impulse response of the room is estimated along with the HRTF by optimizing a parametric model of reverberation based on the statistical behaviour of room acoustics. The posterior distribution of HRTF given the reverberant measurement and excitation signal is modelled using the score-based HRTF prior and a log-likelihood approximation. We show that the resulting method outperforms several baselines, including an oracle recommender system that assigns the optimal HRTF in our training set based on the smallest distance to the true HRTF at the given direction of arrival. In particular, we show that the diffusion prior can account for the large variability of high-frequency content in HRTFs.
title HRTF Estimation using a Score-based Prior
topic Audio and Speech Processing
Machine Learning
Sound
url https://arxiv.org/abs/2410.01562