Saved in:
Bibliographic Details
Main Authors: Jaehun Kim, Florian Henkel, Camilo Landau, Samuel E. Sandberg, Andreas F. Ehmann
Format: Recurso digital
Language:
Published: Zenodo 2024
Online Access:https://doi.org/10.5281/zenodo.14877040
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866901139112329216
author Jaehun Kim
Florian Henkel
Camilo Landau
Samuel E. Sandberg
Andreas F. Ehmann
author_facet Jaehun Kim
Florian Henkel
Camilo Landau
Samuel E. Sandberg
Andreas F. Ehmann
contents The majority of Western popular music contains lyrics. Previous studies have shown that lyrics are a rich source of information and are complementary to other information sources, such as audio. One factor that hinders the research and application of lyrics on a large scale is their availability. To mitigate this, we propose the use of transcriptionbased lyrics embeddings (TLE). These estimate 'groundtruth' lyrics embeddings given only audio as input. Central to this approach is the use of transcripts derived from an automatic lyrics transcription (ALT) system instead of human-transcribed, 'ground-truth' lyrics, making them substantially more accessible. We conduct an experiment to assess the effectiveness of TLEs across various music information retrieval (MIR) tasks. Our results indicate that TLEs can improve the performance of audio embeddings alone, especially when combined, closing the gap with cases where ground-truth lyrics information is available.
format Recurso digital
id zenodo_https___doi_org_10_5281_zenodo_14877040
institution Zenodo
language
publishDate 2024
publisher Zenodo
record_format zenodo
spellingShingle Transcription-Based Lyrics Embeddings: Simple Extraction of Effective Lyrics Embeddings From Audio
Jaehun Kim
Florian Henkel
Camilo Landau
Samuel E. Sandberg
Andreas F. Ehmann
The majority of Western popular music contains lyrics. Previous studies have shown that lyrics are a rich source of information and are complementary to other information sources, such as audio. One factor that hinders the research and application of lyrics on a large scale is their availability. To mitigate this, we propose the use of transcriptionbased lyrics embeddings (TLE). These estimate 'groundtruth' lyrics embeddings given only audio as input. Central to this approach is the use of transcripts derived from an automatic lyrics transcription (ALT) system instead of human-transcribed, 'ground-truth' lyrics, making them substantially more accessible. We conduct an experiment to assess the effectiveness of TLEs across various music information retrieval (MIR) tasks. Our results indicate that TLEs can improve the performance of audio embeddings alone, especially when combined, closing the gap with cases where ground-truth lyrics information is available.
title Transcription-Based Lyrics Embeddings: Simple Extraction of Effective Lyrics Embeddings From Audio
url https://doi.org/10.5281/zenodo.14877040