Go witheFlow: Real-time Emotion Driven Audio Effects Modulation

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Dervakos, Edmund, Kantarelis, Spyridon, Lyberatos, Vassilis, Liartis, Jason, Stamou, Giorgos
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866913158558384128
author Dervakos, Edmund
Kantarelis, Spyridon
Lyberatos, Vassilis
Liartis, Jason
Stamou, Giorgos
author_facet Dervakos, Edmund
Kantarelis, Spyridon
Lyberatos, Vassilis
Liartis, Jason
Stamou, Giorgos
contents Music performance is a distinctly human activity, intrinsically linked to the performer's ability to convey, evoke, or express emotion. Machines cannot perform music in the human sense; they can produce, reproduce, execute, or synthesize music, but they lack the capacity for affective or emotional experience. As such, music performance is an ideal candidate through which to explore aspects of collaboration between humans and machines. In this paper, we introduce the witheFlow system, designed to enhance real-time music performance by automatically modulating audio effects based on features extracted from both biosignals and the audio itself. The system, currently in a proof-of-concept phase, is designed to be lightweight, able to run locally on a laptop, and is open-source given the availability of a compatible Digital Audio Workstation and sensors.
format Preprint
id arxiv_https___arxiv_org_abs_2510_02171
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Go witheFlow: Real-time Emotion Driven Audio Effects Modulation
Dervakos, Edmund
Kantarelis, Spyridon
Lyberatos, Vassilis
Liartis, Jason
Stamou, Giorgos
Sound
Artificial Intelligence
Audio and Speech Processing
Music performance is a distinctly human activity, intrinsically linked to the performer's ability to convey, evoke, or express emotion. Machines cannot perform music in the human sense; they can produce, reproduce, execute, or synthesize music, but they lack the capacity for affective or emotional experience. As such, music performance is an ideal candidate through which to explore aspects of collaboration between humans and machines. In this paper, we introduce the witheFlow system, designed to enhance real-time music performance by automatically modulating audio effects based on features extracted from both biosignals and the audio itself. The system, currently in a proof-of-concept phase, is designed to be lightweight, able to run locally on a laptop, and is open-source given the availability of a compatible Digital Audio Workstation and sensors.
title Go witheFlow: Real-time Emotion Driven Audio Effects Modulation
topic Sound
Artificial Intelligence
Audio and Speech Processing
url https://arxiv.org/abs/2510.02171