Ambisonics Encoder for Wearable Array with Improved Binaural Reproduction

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Gayer, Yhonatan, Tourbabin, Vladimir, Ben-Hur, Zamir, Alon, David, Rafaely, Boaz
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911041271627776
author Gayer, Yhonatan
Tourbabin, Vladimir
Ben-Hur, Zamir
Alon, David
Rafaely, Boaz
author_facet Gayer, Yhonatan
Tourbabin, Vladimir
Ben-Hur, Zamir
Alon, David
Rafaely, Boaz
contents Ambisonics Signal Matching (ASM) is a recently proposed signal-independent approach to encoding Ambisonic signal from wearable microphone arrays, enabling efficient and standardized spatial sound reproduction. However, reproduction accuracy is currently limited due to the non-ideal layout of the microphones. This research introduces an enhanced ASM encoder that reformulates the loss function by integrating a Binaural Signal Matching (BSM) term into the optimization framework. The aim of this reformulation is to improve the accuracy of binaural reproduction when integrating the Ambisonic signal with Head-Related Transfer Functions (HRTFs), making the encoded Ambisonic signal better suited for binaural reproduction. This paper first presents the mathematical formulation developed to align the ASM and BSM objectives in a single loss function, followed by a simulation study with a simulated microphone array mounted on a rigid sphere representing a head-mounted wearable array. The analysis shows that improved binaural reproduction with the encoded Ambisonic signal can be achieved using this joint ASM-BSM optimization, thereby enabling higher-quality binaural playback for virtual and augmented reality applications based on Ambisonics.
format Preprint
id arxiv_https___arxiv_org_abs_2507_04108
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Ambisonics Encoder for Wearable Array with Improved Binaural Reproduction
Gayer, Yhonatan
Tourbabin, Vladimir
Ben-Hur, Zamir
Alon, David
Rafaely, Boaz
Audio and Speech Processing
Signal Processing
Ambisonics Signal Matching (ASM) is a recently proposed signal-independent approach to encoding Ambisonic signal from wearable microphone arrays, enabling efficient and standardized spatial sound reproduction. However, reproduction accuracy is currently limited due to the non-ideal layout of the microphones. This research introduces an enhanced ASM encoder that reformulates the loss function by integrating a Binaural Signal Matching (BSM) term into the optimization framework. The aim of this reformulation is to improve the accuracy of binaural reproduction when integrating the Ambisonic signal with Head-Related Transfer Functions (HRTFs), making the encoded Ambisonic signal better suited for binaural reproduction. This paper first presents the mathematical formulation developed to align the ASM and BSM objectives in a single loss function, followed by a simulation study with a simulated microphone array mounted on a rigid sphere representing a head-mounted wearable array. The analysis shows that improved binaural reproduction with the encoded Ambisonic signal can be achieved using this joint ASM-BSM optimization, thereby enabling higher-quality binaural playback for virtual and augmented reality applications based on Ambisonics.
title Ambisonics Encoder for Wearable Array with Improved Binaural Reproduction
topic Audio and Speech Processing
Signal Processing
url https://arxiv.org/abs/2507.04108