Interpolation Filter Design for Sample Rate Independent Audio Effect RNNs

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Carson, Alistair, Wright, Alec, Bilbao, Stefan
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913670489964544
author Carson, Alistair
Wright, Alec
Bilbao, Stefan
author_facet Carson, Alistair
Wright, Alec
Bilbao, Stefan
contents Recurrent neural networks (RNNs) are effective at emulating the non-linear, stateful behavior of analog guitar amplifiers and distortion effects. Unlike the case of direct circuit simulation, RNNs have a fixed sample rate encoded in their model weights, making the sample rate non-adjustable during inference. Recent work has proposed increasing the sample rate of RNNs at inference (oversampling) by increasing the feedback delay length in samples, using a fractional delay filter for non-integer conversions. Here, we investigate the task of lowering the sample rate at inference (undersampling), and propose using an extrapolation filter to approximate the required fractional signal advance. We consider two filter design methods and analyse the impact of filter order on audio quality. Our results show that the correct choice of filter can give high quality results for both oversampling and undersampling; however, in some cases the sample rate adjustment leads to unwanted artefacts in the output signal. We analyse these failure cases through linearised stability analysis, showing that they result from instability around a fixed point. This approach enables an informed prediction of suitable interpolation filters for a given RNN model before runtime.
format Preprint
id arxiv_https___arxiv_org_abs_2409_15884
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Interpolation Filter Design for Sample Rate Independent Audio Effect RNNs
Carson, Alistair
Wright, Alec
Bilbao, Stefan
Audio and Speech Processing
Sound
Signal Processing
Recurrent neural networks (RNNs) are effective at emulating the non-linear, stateful behavior of analog guitar amplifiers and distortion effects. Unlike the case of direct circuit simulation, RNNs have a fixed sample rate encoded in their model weights, making the sample rate non-adjustable during inference. Recent work has proposed increasing the sample rate of RNNs at inference (oversampling) by increasing the feedback delay length in samples, using a fractional delay filter for non-integer conversions. Here, we investigate the task of lowering the sample rate at inference (undersampling), and propose using an extrapolation filter to approximate the required fractional signal advance. We consider two filter design methods and analyse the impact of filter order on audio quality. Our results show that the correct choice of filter can give high quality results for both oversampling and undersampling; however, in some cases the sample rate adjustment leads to unwanted artefacts in the output signal. We analyse these failure cases through linearised stability analysis, showing that they result from instability around a fixed point. This approach enables an informed prediction of suitable interpolation filters for a given RNN model before runtime.
title Interpolation Filter Design for Sample Rate Independent Audio Effect RNNs
topic Audio and Speech Processing
Sound
Signal Processing
url https://arxiv.org/abs/2409.15884