The Ghost in the Keys: A Disklavier Demo for Human-AI Musical Co-Creativity

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Bradshaw, Louis, Spangher, Alexander, Biderman, Stella, Colton, Simon
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866918183809581056
author Bradshaw, Louis
Spangher, Alexander
Biderman, Stella
Colton, Simon
author_facet Bradshaw, Louis
Spangher, Alexander
Biderman, Stella
Colton, Simon
contents While generative models for music composition are increasingly capable, their adoption by musicians is hindered by text-prompting, an asynchronous workflow disconnected from the embodied, responsive nature of instrumental performance. To address this, we introduce Aria-Duet, an interactive system facilitating a real-time musical duet between a human pianist and Aria, a state-of-the-art generative model, using a Yamaha Disklavier as a shared physical interface. The framework enables a turn-taking collaboration: the user performs, signals a handover, and the model generates a coherent continuation performed acoustically on the piano. Beyond describing the technical architecture enabling this low-latency interaction, we analyze the system's output from a musicological perspective, finding the model can maintain stylistic semantics and develop coherent phrasal ideas, demonstrating that such embodied systems can engage in musically sophisticated dialogue and open a promising new path for human-AI co-creation.
format Preprint
id arxiv_https___arxiv_org_abs_2511_01663
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle The Ghost in the Keys: A Disklavier Demo for Human-AI Musical Co-Creativity
Bradshaw, Louis
Spangher, Alexander
Biderman, Stella
Colton, Simon
Sound
Artificial Intelligence
Human-Computer Interaction
While generative models for music composition are increasingly capable, their adoption by musicians is hindered by text-prompting, an asynchronous workflow disconnected from the embodied, responsive nature of instrumental performance. To address this, we introduce Aria-Duet, an interactive system facilitating a real-time musical duet between a human pianist and Aria, a state-of-the-art generative model, using a Yamaha Disklavier as a shared physical interface. The framework enables a turn-taking collaboration: the user performs, signals a handover, and the model generates a coherent continuation performed acoustically on the piano. Beyond describing the technical architecture enabling this low-latency interaction, we analyze the system's output from a musicological perspective, finding the model can maintain stylistic semantics and develop coherent phrasal ideas, demonstrating that such embodied systems can engage in musically sophisticated dialogue and open a promising new path for human-AI co-creation.
title The Ghost in the Keys: A Disklavier Demo for Human-AI Musical Co-Creativity
topic Sound
Artificial Intelligence
Human-Computer Interaction
url https://arxiv.org/abs/2511.01663