Explicit Context-Driven Neural Acoustic Modeling for High-Fidelity RIR Generation

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Si, Chen, Wu, Qianyi, Amballa, Chaitanya, Choudhury, Romit Roy
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909796180951040
author Si, Chen
Wu, Qianyi
Amballa, Chaitanya
Choudhury, Romit Roy
author_facet Si, Chen
Wu, Qianyi
Amballa, Chaitanya
Choudhury, Romit Roy
contents Realistic sound simulation plays a critical role in many applications. A key element in sound simulation is the room impulse response (RIR), which characterizes how sound propagates from a source to a listener within a given space. Recent studies have applied neural implicit methods to learn RIR using context information collected from the environment, such as scene images. However, these approaches do not effectively leverage explicit geometric information from the environment. To further exploit the potential of neural implicit models with direct geometric features, we present Mesh-infused Neural Acoustic Field (MiNAF), which queries a rough room mesh at given locations and extracts distance distributions as an explicit representation of local context. Our approach demonstrates that incorporating explicit local geometric features can better guide the neural network in generating more accurate RIR predictions. Through comparisons with conventional and state-of-the-art baseline methods, we show that MiNAF performs competitively across various evaluation metrics. Furthermore, we verify the robustness of MiNAF in datasets with limited training samples, demonstrating an advance in high-fidelity sound simulation.
format Preprint
id arxiv_https___arxiv_org_abs_2509_15210
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Explicit Context-Driven Neural Acoustic Modeling for High-Fidelity RIR Generation
Si, Chen
Wu, Qianyi
Amballa, Chaitanya
Choudhury, Romit Roy
Sound
Artificial Intelligence
Machine Learning
Realistic sound simulation plays a critical role in many applications. A key element in sound simulation is the room impulse response (RIR), which characterizes how sound propagates from a source to a listener within a given space. Recent studies have applied neural implicit methods to learn RIR using context information collected from the environment, such as scene images. However, these approaches do not effectively leverage explicit geometric information from the environment. To further exploit the potential of neural implicit models with direct geometric features, we present Mesh-infused Neural Acoustic Field (MiNAF), which queries a rough room mesh at given locations and extracts distance distributions as an explicit representation of local context. Our approach demonstrates that incorporating explicit local geometric features can better guide the neural network in generating more accurate RIR predictions. Through comparisons with conventional and state-of-the-art baseline methods, we show that MiNAF performs competitively across various evaluation metrics. Furthermore, we verify the robustness of MiNAF in datasets with limited training samples, demonstrating an advance in high-fidelity sound simulation.
title Explicit Context-Driven Neural Acoustic Modeling for High-Fidelity RIR Generation
topic Sound
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2509.15210