DiffAU: Diffusion-Based Ambisonics Upscaling

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Milstein, Amit, Shlezinger, Nir, Rafaely, Boaz
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866910272683245568
author Milstein, Amit
Shlezinger, Nir
Rafaely, Boaz
author_facet Milstein, Amit
Shlezinger, Nir
Rafaely, Boaz
contents Spatial audio enhances immersion by reproducing 3D sound fields, with Ambisonics offering a scalable format for this purpose. While first-order Ambisonics (FOA) notably facilitates hardware-efficient acquisition and storage of sound fields as compared to high-order Ambisonics (HOA), its low spatial resolution limits realism, highlighting the need for Ambisonics upscaling (AU) as an approach for increasing the order of Ambisonics signals. In this work we propose DiffAU, a cascaded AU method that leverages recent developments in diffusion models combined with novel adaptation to spatial audio to generate 3rd order Ambisonics from FOA. By learning data distributions, DiffAU provides a principled approach that rapidly and reliably reproduces HOA in various settings. Experiments in anechoic conditions with multiple speakers, show strong objective and perceptual performance.
format Preprint
id arxiv_https___arxiv_org_abs_2510_00180
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle DiffAU: Diffusion-Based Ambisonics Upscaling
Milstein, Amit
Shlezinger, Nir
Rafaely, Boaz
Audio and Speech Processing
Sound
Signal Processing
Spatial audio enhances immersion by reproducing 3D sound fields, with Ambisonics offering a scalable format for this purpose. While first-order Ambisonics (FOA) notably facilitates hardware-efficient acquisition and storage of sound fields as compared to high-order Ambisonics (HOA), its low spatial resolution limits realism, highlighting the need for Ambisonics upscaling (AU) as an approach for increasing the order of Ambisonics signals. In this work we propose DiffAU, a cascaded AU method that leverages recent developments in diffusion models combined with novel adaptation to spatial audio to generate 3rd order Ambisonics from FOA. By learning data distributions, DiffAU provides a principled approach that rapidly and reliably reproduces HOA in various settings. Experiments in anechoic conditions with multiple speakers, show strong objective and perceptual performance.
title DiffAU: Diffusion-Based Ambisonics Upscaling
topic Audio and Speech Processing
Sound
Signal Processing
url https://arxiv.org/abs/2510.00180