Automatic Sound Event Detection and Classification of Great Ape Calls Using Neural Networks
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914842636451840 |
|---|---|
| author | Jiang, Zifan Soldati, Adrian Schamberg, Isaac Lameira, Adriano R. Moran, Steven |
| author_facet | Jiang, Zifan Soldati, Adrian Schamberg, Isaac Lameira, Adriano R. Moran, Steven |
| contents | We present a novel approach to automatically detect and classify great ape calls from continuous raw audio recordings collected during field research. Our method leverages deep pretrained and sequential neural networks, including wav2vec 2.0 and LSTM, and is validated on three data sets from three different great ape lineages (orangutans, chimpanzees, and bonobos). The recordings were collected by different researchers and include different annotation schemes, which our pipeline preprocesses and trains in a uniform fashion. Our results for call detection and classification attain high accuracy. Our method is aimed to be generalizable to other animal species, and more generally, sound event detection tasks. To foster future research, we make our pipeline and methods publicly available. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2301_02214 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Automatic Sound Event Detection and Classification of Great Ape Calls Using Neural Networks Jiang, Zifan Soldati, Adrian Schamberg, Isaac Lameira, Adriano R. Moran, Steven Audio and Speech Processing Sound We present a novel approach to automatically detect and classify great ape calls from continuous raw audio recordings collected during field research. Our method leverages deep pretrained and sequential neural networks, including wav2vec 2.0 and LSTM, and is validated on three data sets from three different great ape lineages (orangutans, chimpanzees, and bonobos). The recordings were collected by different researchers and include different annotation schemes, which our pipeline preprocesses and trains in a uniform fashion. Our results for call detection and classification attain high accuracy. Our method is aimed to be generalizable to other animal species, and more generally, sound event detection tasks. To foster future research, we make our pipeline and methods publicly available. |
| title | Automatic Sound Event Detection and Classification of Great Ape Calls Using Neural Networks |
| topic | Audio and Speech Processing Sound |
| url | https://arxiv.org/abs/2301.02214 |