A benchmark for computational analysis of animal behavior, using animal-borne tags

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Hoffman, Benjamin, Cusimano, Maddie, Baglione, Vittorio, Canestrari, Daniela, Chevallier, Damien, DeSantis, Dominic L., Jeantet, Lorène, Ladds, Monique A., Maekawa, Takuya, Mata-Silva, Vicente, Moreno-González, Víctor, Pagano, Anthony, Trapote, Eva, Vainio, Outi, Vehkaoja, Antti, Yoda, Ken, Zacarian, Katherine, Friedlaender, Ari
Format: Preprint
Published: 2023
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917875776749568
author Hoffman, Benjamin
Cusimano, Maddie
Baglione, Vittorio
Canestrari, Daniela
Chevallier, Damien
DeSantis, Dominic L.
Jeantet, Lorène
Ladds, Monique A.
Maekawa, Takuya
Mata-Silva, Vicente
Moreno-González, Víctor
Pagano, Anthony
Trapote, Eva
Vainio, Outi
Vehkaoja, Antti
Yoda, Ken
Zacarian, Katherine
Friedlaender, Ari
author_facet Hoffman, Benjamin
Cusimano, Maddie
Baglione, Vittorio
Canestrari, Daniela
Chevallier, Damien
DeSantis, Dominic L.
Jeantet, Lorène
Ladds, Monique A.
Maekawa, Takuya
Mata-Silva, Vicente
Moreno-González, Víctor
Pagano, Anthony
Trapote, Eva
Vainio, Outi
Vehkaoja, Antti
Yoda, Ken
Zacarian, Katherine
Friedlaender, Ari
contents Animal-borne sensors (`bio-loggers') can record a suite of kinematic and environmental data, which are used to elucidate animal ecophysiology and improve conservation efforts. Machine learning techniques are used for interpreting the large amounts of data recorded by bio-loggers, but there exists no common framework for comparing the different machine learning techniques in this domain. This makes it difficult to, for example, identify patterns in what works well for machine learning-based analysis of bio-logger data. It also makes it difficult to evaluate the effectiveness of novel methods developed by the machine learning community. To address this, we present the Bio-logger Ethogram Benchmark (BEBE), a collection of datasets with behavioral annotations, as well as a modeling task and evaluation metrics. BEBE is to date the largest, most taxonomically diverse, publicly available benchmark of this type. Using BEBE, we compare the performance of deep and classical machine learning methods for identifying animal behaviors based on bio-logger data. As an example usage of BEBE, we test an approach based on self-supervised learning. To apply this approach to animal behavior classification, we adapt a deep neural network pre-trained with 700,000 hours of data collected from human wrist-worn accelerometers. We find that deep neural networks out-perform the classical machine learning methods we tested across all nine datasets in BEBE. We additionally find that the approach based on self-supervised learning out-performs the alternatives we tested, especially in settings when there is a low amount of training data available. In light of this, we are able to make concrete suggestions for designing studies that rely on machine learning to infer behavior from bio-logger data. Datasets and code are available at https://github.com/earthspecies/BEBE.
format Preprint
id arxiv_https___arxiv_org_abs_2305_10740
institution arXiv
publishDate 2023
record_format arxiv
spellingShingle A benchmark for computational analysis of animal behavior, using animal-borne tags
Hoffman, Benjamin
Cusimano, Maddie
Baglione, Vittorio
Canestrari, Daniela
Chevallier, Damien
DeSantis, Dominic L.
Jeantet, Lorène
Ladds, Monique A.
Maekawa, Takuya
Mata-Silva, Vicente
Moreno-González, Víctor
Pagano, Anthony
Trapote, Eva
Vainio, Outi
Vehkaoja, Antti
Yoda, Ken
Zacarian, Katherine
Friedlaender, Ari
Machine Learning
Quantitative Methods
Animal-borne sensors (`bio-loggers') can record a suite of kinematic and environmental data, which are used to elucidate animal ecophysiology and improve conservation efforts. Machine learning techniques are used for interpreting the large amounts of data recorded by bio-loggers, but there exists no common framework for comparing the different machine learning techniques in this domain. This makes it difficult to, for example, identify patterns in what works well for machine learning-based analysis of bio-logger data. It also makes it difficult to evaluate the effectiveness of novel methods developed by the machine learning community. To address this, we present the Bio-logger Ethogram Benchmark (BEBE), a collection of datasets with behavioral annotations, as well as a modeling task and evaluation metrics. BEBE is to date the largest, most taxonomically diverse, publicly available benchmark of this type. Using BEBE, we compare the performance of deep and classical machine learning methods for identifying animal behaviors based on bio-logger data. As an example usage of BEBE, we test an approach based on self-supervised learning. To apply this approach to animal behavior classification, we adapt a deep neural network pre-trained with 700,000 hours of data collected from human wrist-worn accelerometers. We find that deep neural networks out-perform the classical machine learning methods we tested across all nine datasets in BEBE. We additionally find that the approach based on self-supervised learning out-performs the alternatives we tested, especially in settings when there is a low amount of training data available. In light of this, we are able to make concrete suggestions for designing studies that rely on machine learning to infer behavior from bio-logger data. Datasets and code are available at https://github.com/earthspecies/BEBE.
title A benchmark for computational analysis of animal behavior, using animal-borne tags
topic Machine Learning
Quantitative Methods
url https://arxiv.org/abs/2305.10740