From Forest to Zoo: Great Ape Behavior Recognition with ChimpBehave

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Fuchs, Michael, Genty, Emilie, Bangerter, Adrian, Zuberbühler, Klaus, Cotofrei, Paul
Format: Preprint
Published: 2024
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866913370568916992
author Fuchs, Michael
Genty, Emilie
Bangerter, Adrian
Zuberbühler, Klaus
Cotofrei, Paul
author_facet Fuchs, Michael
Genty, Emilie
Bangerter, Adrian
Zuberbühler, Klaus
Cotofrei, Paul
contents This paper addresses the significant challenge of recognizing behaviors in non-human primates, specifically focusing on chimpanzees. Automated behavior recognition is crucial for both conservation efforts and the advancement of behavioral research. However, it is significantly hindered by the labor-intensive process of manual video annotation. Despite the availability of large-scale animal behavior datasets, the effective application of machine learning models across varied environmental settings poses a critical challenge, primarily due to the variability in data collection contexts and the specificity of annotations. In this paper, we introduce ChimpBehave, a novel dataset featuring over 2 hours of video (approximately 193,000 video frames) of zoo-housed chimpanzees, meticulously annotated with bounding boxes and behavior labels for action recognition. ChimpBehave uniquely aligns its behavior classes with existing datasets, allowing for the study of domain adaptation and cross-dataset generalization methods between different visual settings. Furthermore, we benchmark our dataset using a state-of-the-art CNN-based action recognition model, providing the first baseline results for both within and cross-dataset settings. The dataset, models, and code can be accessed at: https://github.com/MitchFuchs/ChimpBehave
format Preprint
id arxiv_https___arxiv_org_abs_2405_20025
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle From Forest to Zoo: Great Ape Behavior Recognition with ChimpBehave
Fuchs, Michael
Genty, Emilie
Bangerter, Adrian
Zuberbühler, Klaus
Cotofrei, Paul
Computer Vision and Pattern Recognition
This paper addresses the significant challenge of recognizing behaviors in non-human primates, specifically focusing on chimpanzees. Automated behavior recognition is crucial for both conservation efforts and the advancement of behavioral research. However, it is significantly hindered by the labor-intensive process of manual video annotation. Despite the availability of large-scale animal behavior datasets, the effective application of machine learning models across varied environmental settings poses a critical challenge, primarily due to the variability in data collection contexts and the specificity of annotations. In this paper, we introduce ChimpBehave, a novel dataset featuring over 2 hours of video (approximately 193,000 video frames) of zoo-housed chimpanzees, meticulously annotated with bounding boxes and behavior labels for action recognition. ChimpBehave uniquely aligns its behavior classes with existing datasets, allowing for the study of domain adaptation and cross-dataset generalization methods between different visual settings. Furthermore, we benchmark our dataset using a state-of-the-art CNN-based action recognition model, providing the first baseline results for both within and cross-dataset settings. The dataset, models, and code can be accessed at: https://github.com/MitchFuchs/ChimpBehave
title From Forest to Zoo: Great Ape Behavior Recognition with ChimpBehave
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2405.20025