Lyrics Transcription for Humans: A Readability-Aware Benchmark

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Cífka, Ondřej, Schreiber, Hendrik, Miner, Luke, Stöter, Fabian-Robert
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866916355190554624
author Cífka, Ondřej
Schreiber, Hendrik
Miner, Luke
Stöter, Fabian-Robert
author_facet Cífka, Ondřej
Schreiber, Hendrik
Miner, Luke
Stöter, Fabian-Robert
contents Writing down lyrics for human consumption involves not only accurately capturing word sequences, but also incorporating punctuation and formatting for clarity and to convey contextual information. This includes song structure, emotional emphasis, and contrast between lead and background vocals. While automatic lyrics transcription (ALT) systems have advanced beyond producing unstructured strings of words and are able to draw on wider context, ALT benchmarks have not kept pace and continue to focus exclusively on words. To address this gap, we introduce Jam-ALT, a comprehensive lyrics transcription benchmark. The benchmark features a complete revision of the JamendoLyrics dataset, in adherence to industry standards for lyrics transcription and formatting, along with evaluation metrics designed to capture and assess the lyric-specific nuances, laying the foundation for improving the readability of lyrics. We apply the benchmark to recent transcription systems and present additional error analysis, as well as an experimental comparison with a classical music dataset.
format Preprint
id arxiv_https___arxiv_org_abs_2408_06370
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Lyrics Transcription for Humans: A Readability-Aware Benchmark
Cífka, Ondřej
Schreiber, Hendrik
Miner, Luke
Stöter, Fabian-Robert
Audio and Speech Processing
Computation and Language
Machine Learning
Sound
Writing down lyrics for human consumption involves not only accurately capturing word sequences, but also incorporating punctuation and formatting for clarity and to convey contextual information. This includes song structure, emotional emphasis, and contrast between lead and background vocals. While automatic lyrics transcription (ALT) systems have advanced beyond producing unstructured strings of words and are able to draw on wider context, ALT benchmarks have not kept pace and continue to focus exclusively on words. To address this gap, we introduce Jam-ALT, a comprehensive lyrics transcription benchmark. The benchmark features a complete revision of the JamendoLyrics dataset, in adherence to industry standards for lyrics transcription and formatting, along with evaluation metrics designed to capture and assess the lyric-specific nuances, laying the foundation for improving the readability of lyrics. We apply the benchmark to recent transcription systems and present additional error analysis, as well as an experimental comparison with a classical music dataset.
title Lyrics Transcription for Humans: A Readability-Aware Benchmark
topic Audio and Speech Processing
Computation and Language
Machine Learning
Sound
url https://arxiv.org/abs/2408.06370