YNote: A Novel Music Notation for Fine-Tuning LLMs in Music Generation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Lu, Shao-Chien, Yeh, Chen-Chen, Cho, Hui-Lin, Hsu, Chun-Chieh, Hsu, Tsai-Ling, Wu, Cheng-Han, Shih, Timothy K., Lin, Yu-Cheng
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913691421638656
author Lu, Shao-Chien
Yeh, Chen-Chen
Cho, Hui-Lin
Hsu, Chun-Chieh
Hsu, Tsai-Ling
Wu, Cheng-Han
Shih, Timothy K.
Lin, Yu-Cheng
author_facet Lu, Shao-Chien
Yeh, Chen-Chen
Cho, Hui-Lin
Hsu, Chun-Chieh
Hsu, Tsai-Ling
Wu, Cheng-Han
Shih, Timothy K.
Lin, Yu-Cheng
contents The field of music generation using Large Language Models (LLMs) is evolving rapidly, yet existing music notation systems, such as MIDI, ABC Notation, and MusicXML, remain too complex for effective fine-tuning of LLMs. These formats are difficult for both machines and humans to interpret due to their variability and intricate structure. To address these challenges, we introduce YNote, a simplified music notation system that uses only four characters to represent a note and its pitch. YNote's fixed format ensures consistency, making it easy to read and more suitable for fine-tuning LLMs. In our experiments, we fine-tuned GPT-2 (124M) on a YNote-encoded dataset and achieved BLEU and ROUGE scores of 0.883 and 0.766, respectively. With just two notes as prompts, the model was able to generate coherent and stylistically relevant music. We believe YNote offers a practical alternative to existing music notations for machine learning applications and has the potential to significantly enhance the quality of music generation using LLMs.
format Preprint
id arxiv_https___arxiv_org_abs_2502_10467
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle YNote: A Novel Music Notation for Fine-Tuning LLMs in Music Generation
Lu, Shao-Chien
Yeh, Chen-Chen
Cho, Hui-Lin
Hsu, Chun-Chieh
Hsu, Tsai-Ling
Wu, Cheng-Han
Shih, Timothy K.
Lin, Yu-Cheng
Sound
Artificial Intelligence
Audio and Speech Processing
The field of music generation using Large Language Models (LLMs) is evolving rapidly, yet existing music notation systems, such as MIDI, ABC Notation, and MusicXML, remain too complex for effective fine-tuning of LLMs. These formats are difficult for both machines and humans to interpret due to their variability and intricate structure. To address these challenges, we introduce YNote, a simplified music notation system that uses only four characters to represent a note and its pitch. YNote's fixed format ensures consistency, making it easy to read and more suitable for fine-tuning LLMs. In our experiments, we fine-tuned GPT-2 (124M) on a YNote-encoded dataset and achieved BLEU and ROUGE scores of 0.883 and 0.766, respectively. With just two notes as prompts, the model was able to generate coherent and stylistically relevant music. We believe YNote offers a practical alternative to existing music notations for machine learning applications and has the potential to significantly enhance the quality of music generation using LLMs.
title YNote: A Novel Music Notation for Fine-Tuning LLMs in Music Generation
topic Sound
Artificial Intelligence
Audio and Speech Processing
url https://arxiv.org/abs/2502.10467