Fourier-based Action Recognition for Wildlife Behavior Quantification with Event Cameras
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866912195949887488 |
|---|---|
| author | Hamann, Friedhelm Ghosh, Suman Martinez, Ignacio Juarez Hart, Tom Kacelnik, Alex Gallego, Guillermo |
| author_facet | Hamann, Friedhelm Ghosh, Suman Martinez, Ignacio Juarez Hart, Tom Kacelnik, Alex Gallego, Guillermo |
| contents | Event cameras are novel bio-inspired vision sensors that measure pixel-wise brightness changes asynchronously instead of images at a given frame rate. They offer promising advantages, namely a high dynamic range, low latency, and minimal motion blur. Modern computer vision algorithms often rely on artificial neural network approaches, which require image-like representations of the data and cannot fully exploit the characteristics of event data. We propose approaches to action recognition based on the Fourier Transform. The approaches are intended to recognize oscillating motion patterns commonly present in nature. In particular, we apply our approaches to a recent dataset of breeding penguins annotated for "ecstatic display", a behavior where the observed penguins flap their wings at a certain frequency. We find that our approaches are both simple and effective, producing slightly lower results than a deep neural network (DNN) while relying just on a tiny fraction of the parameters compared to the DNN (five orders of magnitude fewer parameters). They work well despite the uncontrolled, diverse data present in the dataset. We hope this work opens a new perspective on event-based processing and action recognition. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_06698 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Fourier-based Action Recognition for Wildlife Behavior Quantification with Event Cameras Hamann, Friedhelm Ghosh, Suman Martinez, Ignacio Juarez Hart, Tom Kacelnik, Alex Gallego, Guillermo Computer Vision and Pattern Recognition Emerging Technologies Event cameras are novel bio-inspired vision sensors that measure pixel-wise brightness changes asynchronously instead of images at a given frame rate. They offer promising advantages, namely a high dynamic range, low latency, and minimal motion blur. Modern computer vision algorithms often rely on artificial neural network approaches, which require image-like representations of the data and cannot fully exploit the characteristics of event data. We propose approaches to action recognition based on the Fourier Transform. The approaches are intended to recognize oscillating motion patterns commonly present in nature. In particular, we apply our approaches to a recent dataset of breeding penguins annotated for "ecstatic display", a behavior where the observed penguins flap their wings at a certain frequency. We find that our approaches are both simple and effective, producing slightly lower results than a deep neural network (DNN) while relying just on a tiny fraction of the parameters compared to the DNN (five orders of magnitude fewer parameters). They work well despite the uncontrolled, diverse data present in the dataset. We hope this work opens a new perspective on event-based processing and action recognition. |
| title | Fourier-based Action Recognition for Wildlife Behavior Quantification with Event Cameras |
| topic | Computer Vision and Pattern Recognition Emerging Technologies |
| url | https://arxiv.org/abs/2410.06698 |