Gradient-based Optimisation of Modulation Effects

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Carson, Alistair, Wright, Alec, Bilbao, Stefan
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918440346845184
author Carson, Alistair
Wright, Alec
Bilbao, Stefan
author_facet Carson, Alistair
Wright, Alec
Bilbao, Stefan
contents Modulation effects such as phasers, flangers and chorus effects are heavily used in conjunction with the electric guitar. Machine learning based emulation of analog modulation units has been investigated in recent years, but most methods have either been limited to one class of effect or suffer from a high computational cost or latency compared to canonical digital implementations. Here, we build on previous work and present a framework for modelling flanger, chorus and phaser effects based on differentiable digital signal processing. The model is trained in the time-frequency domain, but at inference operates in the time-domain, requiring zero latency. We investigate the challenges associated with gradient-based optimisation of such effects, and show that low-frequency weighting of loss functions avoids convergence to local minima when learning delay times. We show that when trained against analog effects units, sound output from the model is in some cases perceptually indistinguishable from the reference, but challenges still remain for effects with long delay times and feedback.
format Preprint
id arxiv_https___arxiv_org_abs_2601_04867
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Gradient-based Optimisation of Modulation Effects
Carson, Alistair
Wright, Alec
Bilbao, Stefan
Audio and Speech Processing
Machine Learning
Sound
Modulation effects such as phasers, flangers and chorus effects are heavily used in conjunction with the electric guitar. Machine learning based emulation of analog modulation units has been investigated in recent years, but most methods have either been limited to one class of effect or suffer from a high computational cost or latency compared to canonical digital implementations. Here, we build on previous work and present a framework for modelling flanger, chorus and phaser effects based on differentiable digital signal processing. The model is trained in the time-frequency domain, but at inference operates in the time-domain, requiring zero latency. We investigate the challenges associated with gradient-based optimisation of such effects, and show that low-frequency weighting of loss functions avoids convergence to local minima when learning delay times. We show that when trained against analog effects units, sound output from the model is in some cases perceptually indistinguishable from the reference, but challenges still remain for effects with long delay times and feedback.
title Gradient-based Optimisation of Modulation Effects
topic Audio and Speech Processing
Machine Learning
Sound
url https://arxiv.org/abs/2601.04867