Identifying birdsong syllables without labelled data

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Teng, Mélisande, Boussard, Julien, Rolnick, David, Larochelle, Hugo
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908558610661376
author Teng, Mélisande
Boussard, Julien
Rolnick, David
Larochelle, Hugo
author_facet Teng, Mélisande
Boussard, Julien
Rolnick, David
Larochelle, Hugo
contents Identifying sequences of syllables within birdsongs is key to tackling a wide array of challenges, including bird individual identification and better understanding of animal communication and sensory-motor learning. Recently, machine learning approaches have demonstrated great potential to alleviate the need for experts to label long audio recordings by hand. However, they still typically rely on the availability of labelled data for model training, restricting applicability to a few species and datasets. In this work, we build the first fully unsupervised algorithm to decompose birdsong recordings into sequences of syllables. We first detect syllable events, then cluster them to extract templates -- syllable representations -- before performing matching pursuit to decompose the recording as a sequence of syllables. We evaluate our automatic annotations against human labels on a dataset of Bengalese finch songs and find that our unsupervised method achieves high performance. We also demonstrate that our approach can distinguish individual birds within a species through their unique vocal signatures, for both Bengalese finches and another species, the great tit.
format Preprint
id arxiv_https___arxiv_org_abs_2509_18412
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Identifying birdsong syllables without labelled data
Teng, Mélisande
Boussard, Julien
Rolnick, David
Larochelle, Hugo
Sound
Machine Learning
Audio and Speech Processing
Identifying sequences of syllables within birdsongs is key to tackling a wide array of challenges, including bird individual identification and better understanding of animal communication and sensory-motor learning. Recently, machine learning approaches have demonstrated great potential to alleviate the need for experts to label long audio recordings by hand. However, they still typically rely on the availability of labelled data for model training, restricting applicability to a few species and datasets. In this work, we build the first fully unsupervised algorithm to decompose birdsong recordings into sequences of syllables. We first detect syllable events, then cluster them to extract templates -- syllable representations -- before performing matching pursuit to decompose the recording as a sequence of syllables. We evaluate our automatic annotations against human labels on a dataset of Bengalese finch songs and find that our unsupervised method achieves high performance. We also demonstrate that our approach can distinguish individual birds within a species through their unique vocal signatures, for both Bengalese finches and another species, the great tit.
title Identifying birdsong syllables without labelled data
topic Sound
Machine Learning
Audio and Speech Processing
url https://arxiv.org/abs/2509.18412