The PanAf-FGBG Dataset: Understanding the Impact of Backgrounds in Wildlife Behaviour Recognition
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , , , , , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866913745440079872 |
|---|---|
| author | Brookes, Otto Kukushkin, Maksim Mirmehdi, Majid Stephens, Colleen Dieguez, Paula Hicks, Thurston C. Jones, Sorrel Lee, Kevin McCarthy, Maureen S. Meier, Amelia Normand, Emmanuelle Wessling, Erin G. Wittig, Roman M. Langergraber, Kevin Zuberbühler, Klaus Boesch, Lukas Schmid, Thomas Arandjelovic, Mimi Kühl, Hjalmar Burghardt, Tilo |
| author_facet | Brookes, Otto Kukushkin, Maksim Mirmehdi, Majid Stephens, Colleen Dieguez, Paula Hicks, Thurston C. Jones, Sorrel Lee, Kevin McCarthy, Maureen S. Meier, Amelia Normand, Emmanuelle Wessling, Erin G. Wittig, Roman M. Langergraber, Kevin Zuberbühler, Klaus Boesch, Lukas Schmid, Thomas Arandjelovic, Mimi Kühl, Hjalmar Burghardt, Tilo |
| contents | Computer vision analysis of camera trap video footage is essential for wildlife conservation, as captured behaviours offer some of the earliest indicators of changes in population health. Recently, several high-impact animal behaviour datasets and methods have been introduced to encourage their use; however, the role of behaviour-correlated background information and its significant effect on out-of-distribution generalisation remain unexplored. In response, we present the PanAf-FGBG dataset, featuring 20 hours of wild chimpanzee behaviours, recorded at over 350 individual camera locations. Uniquely, it pairs every video with a chimpanzee (referred to as a foreground video) with a corresponding background video (with no chimpanzee) from the same camera location. We present two views of the dataset: one with overlapping camera locations and one with disjoint locations. This setup enables, for the first time, direct evaluation of in-distribution and out-of-distribution conditions, and for the impact of backgrounds on behaviour recognition models to be quantified. All clips come with rich behavioural annotations and metadata including unique camera IDs and detailed textual scene descriptions. Additionally, we establish several baselines and present a highly effective latent-space normalisation technique that boosts out-of-distribution performance by +5.42% mAP for convolutional and +3.75% mAP for transformer-based models. Finally, we provide an in-depth analysis on the role of backgrounds in out-of-distribution behaviour recognition, including the so far unexplored impact of background durations (i.e., the count of background frames within foreground videos). |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2502_21201 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | The PanAf-FGBG Dataset: Understanding the Impact of Backgrounds in Wildlife Behaviour Recognition Brookes, Otto Kukushkin, Maksim Mirmehdi, Majid Stephens, Colleen Dieguez, Paula Hicks, Thurston C. Jones, Sorrel Lee, Kevin McCarthy, Maureen S. Meier, Amelia Normand, Emmanuelle Wessling, Erin G. Wittig, Roman M. Langergraber, Kevin Zuberbühler, Klaus Boesch, Lukas Schmid, Thomas Arandjelovic, Mimi Kühl, Hjalmar Burghardt, Tilo Computer Vision and Pattern Recognition Artificial Intelligence Computer vision analysis of camera trap video footage is essential for wildlife conservation, as captured behaviours offer some of the earliest indicators of changes in population health. Recently, several high-impact animal behaviour datasets and methods have been introduced to encourage their use; however, the role of behaviour-correlated background information and its significant effect on out-of-distribution generalisation remain unexplored. In response, we present the PanAf-FGBG dataset, featuring 20 hours of wild chimpanzee behaviours, recorded at over 350 individual camera locations. Uniquely, it pairs every video with a chimpanzee (referred to as a foreground video) with a corresponding background video (with no chimpanzee) from the same camera location. We present two views of the dataset: one with overlapping camera locations and one with disjoint locations. This setup enables, for the first time, direct evaluation of in-distribution and out-of-distribution conditions, and for the impact of backgrounds on behaviour recognition models to be quantified. All clips come with rich behavioural annotations and metadata including unique camera IDs and detailed textual scene descriptions. Additionally, we establish several baselines and present a highly effective latent-space normalisation technique that boosts out-of-distribution performance by +5.42% mAP for convolutional and +3.75% mAP for transformer-based models. Finally, we provide an in-depth analysis on the role of backgrounds in out-of-distribution behaviour recognition, including the so far unexplored impact of background durations (i.e., the count of background frames within foreground videos). |
| title | The PanAf-FGBG Dataset: Understanding the Impact of Backgrounds in Wildlife Behaviour Recognition |
| topic | Computer Vision and Pattern Recognition Artificial Intelligence |
| url | https://arxiv.org/abs/2502.21201 |