S-KEY: Self-supervised Learning of Major and Minor Keys from Audio
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912443580547072 |
|---|---|
| author | Kong, Yuexuan Meseguer-Brocal, Gabriel Lostanlen, Vincent Lagrange, Mathieu Hennequin, Romain |
| author_facet | Kong, Yuexuan Meseguer-Brocal, Gabriel Lostanlen, Vincent Lagrange, Mathieu Hennequin, Romain |
| contents | STONE, the current method in self-supervised learning for tonality estimation in music signals, cannot distinguish relative keys, such as C major versus A minor. In this article, we extend the neural network architecture and learning objective of STONE to perform self-supervised learning of major and minor keys (S-KEY). Our main contribution is an auxiliary pretext task to STONE, formulated using transposition-invariant chroma features as a source of pseudo-labels. S-KEY matches the supervised state of the art in tonality estimation on FMAKv2 and GTZAN datasets while requiring no human annotation and having the same parameter budget as STONE. We build upon this result and expand the training set of S-KEY to a million songs, thus showing the potential of large-scale self-supervised learning in music information retrieval. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2501_12907 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | S-KEY: Self-supervised Learning of Major and Minor Keys from Audio Kong, Yuexuan Meseguer-Brocal, Gabriel Lostanlen, Vincent Lagrange, Mathieu Hennequin, Romain Sound Audio and Speech Processing STONE, the current method in self-supervised learning for tonality estimation in music signals, cannot distinguish relative keys, such as C major versus A minor. In this article, we extend the neural network architecture and learning objective of STONE to perform self-supervised learning of major and minor keys (S-KEY). Our main contribution is an auxiliary pretext task to STONE, formulated using transposition-invariant chroma features as a source of pseudo-labels. S-KEY matches the supervised state of the art in tonality estimation on FMAKv2 and GTZAN datasets while requiring no human annotation and having the same parameter budget as STONE. We build upon this result and expand the training set of S-KEY to a million songs, thus showing the potential of large-scale self-supervised learning in music information retrieval. |
| title | S-KEY: Self-supervised Learning of Major and Minor Keys from Audio |
| topic | Sound Audio and Speech Processing |
| url | https://arxiv.org/abs/2501.12907 |