Demo of Zero-Shot Guitar Amplifier Modelling: Enhancing Modeling with Hyper Neural Networks

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Chen, Yu-Hua, Cheng, Yuan-Chiao, Yeh, Yen-Tung, Wu, Jui-Te, Ho, Yu-Hsiang, Jang, Jyh-Shing Roger, Yang, Yi-Hsuan
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913535454347264
author Chen, Yu-Hua
Cheng, Yuan-Chiao
Yeh, Yen-Tung
Wu, Jui-Te
Ho, Yu-Hsiang
Jang, Jyh-Shing Roger
Yang, Yi-Hsuan
author_facet Chen, Yu-Hua
Cheng, Yuan-Chiao
Yeh, Yen-Tung
Wu, Jui-Te
Ho, Yu-Hsiang
Jang, Jyh-Shing Roger
Yang, Yi-Hsuan
contents Electric guitar tone modeling typically focuses on the non-linear transformation from clean to amplifier-rendered audio. Traditional methods rely on one-to-one mappings, incorporating device parameters into neural models to replicate specific amplifiers. However, these methods are limited by the need for specific training data. In this paper, we adapt a model based on the previous work, which leverages a tone embedding encoder and a feature wise linear modulation (FiLM) condition method. In this work, we altered conditioning method using a hypernetwork-based gated convolutional network (GCN) to generate audio that blends clean input with the tone characteristics of reference audio. By extending the training data to cover a wider variety of amplifier tones, our model is able to capture a broader range of tones. Additionally, we developed a real-time plugin to demonstrate the system's practical application, allowing users to experience its performance interactively. Our results indicate that the proposed system achieves superior tone modeling versatility compared to traditional methods.
format Preprint
id arxiv_https___arxiv_org_abs_2410_04702
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Demo of Zero-Shot Guitar Amplifier Modelling: Enhancing Modeling with Hyper Neural Networks
Chen, Yu-Hua
Cheng, Yuan-Chiao
Yeh, Yen-Tung
Wu, Jui-Te
Ho, Yu-Hsiang
Jang, Jyh-Shing Roger
Yang, Yi-Hsuan
Sound
Audio and Speech Processing
Electric guitar tone modeling typically focuses on the non-linear transformation from clean to amplifier-rendered audio. Traditional methods rely on one-to-one mappings, incorporating device parameters into neural models to replicate specific amplifiers. However, these methods are limited by the need for specific training data. In this paper, we adapt a model based on the previous work, which leverages a tone embedding encoder and a feature wise linear modulation (FiLM) condition method. In this work, we altered conditioning method using a hypernetwork-based gated convolutional network (GCN) to generate audio that blends clean input with the tone characteristics of reference audio. By extending the training data to cover a wider variety of amplifier tones, our model is able to capture a broader range of tones. Additionally, we developed a real-time plugin to demonstrate the system's practical application, allowing users to experience its performance interactively. Our results indicate that the proposed system achieves superior tone modeling versatility compared to traditional methods.
title Demo of Zero-Shot Guitar Amplifier Modelling: Enhancing Modeling with Hyper Neural Networks
topic Sound
Audio and Speech Processing
url https://arxiv.org/abs/2410.04702