Network Modulation Synthesis: New Algorithms for Generating Musical Audio Using Autoencoder Networks

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autor principal: Hyrkas, Jeremy
Formato: Preprint
Publicado: 2021
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866909809812439040
author Hyrkas, Jeremy
author_facet Hyrkas, Jeremy
contents A new framework is presented for generating musical audio using autoencoder neural networks. With the presented framework, called network modulation synthesis, users can create synthesis architectures and use novel generative algorithms to more easily move through the complex latent parameter space of an autoencoder model to create audio. Implementations of the new algorithms are provided for the open-source CANNe synthesizer network, and can be applied to other autoencoder networks for audio synthesis. Spectrograms and time-series encoding analysis demonstrate that the new algorithms provide simple mechanisms for users to generate time-varying parameter combinations, and therefore auditory possibilities, that are difficult to create by generating audio from handcrafted encodings.
format Preprint
id arxiv_https___arxiv_org_abs_2109_01948
institution arXiv
publishDate 2021
record_format arxiv
spellingShingle Network Modulation Synthesis: New Algorithms for Generating Musical Audio Using Autoencoder Networks
Hyrkas, Jeremy
Sound
Audio and Speech Processing
A new framework is presented for generating musical audio using autoencoder neural networks. With the presented framework, called network modulation synthesis, users can create synthesis architectures and use novel generative algorithms to more easily move through the complex latent parameter space of an autoencoder model to create audio. Implementations of the new algorithms are provided for the open-source CANNe synthesizer network, and can be applied to other autoencoder networks for audio synthesis. Spectrograms and time-series encoding analysis demonstrate that the new algorithms provide simple mechanisms for users to generate time-varying parameter combinations, and therefore auditory possibilities, that are difficult to create by generating audio from handcrafted encodings.
title Network Modulation Synthesis: New Algorithms for Generating Musical Audio Using Autoencoder Networks
topic Sound
Audio and Speech Processing
url https://arxiv.org/abs/2109.01948