Gespeichert in:
| Hauptverfasser: | , , , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2024
|
| Schlagworte: | |
| Online-Zugang: | https://arxiv.org/abs/2407.20623 |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866929523351617536 |
|---|---|
| author | Varini, Filippo Gayford, Joel H. Jenrette, Jeremy Witt, Matthew J. Garzon, Francesco Ferretti, Francesco Wilday, Sophie Bond, Mark E. Heithaus, Michael R. Robinson, Danielle Carter, Devon Gumbs, Najee Webster, Vincent Glocker, Ben |
| author_facet | Varini, Filippo Gayford, Joel H. Jenrette, Jeremy Witt, Matthew J. Garzon, Francesco Ferretti, Francesco Wilday, Sophie Bond, Mark E. Heithaus, Michael R. Robinson, Danielle Carter, Devon Gumbs, Najee Webster, Vincent Glocker, Ben |
| contents | Elasmobranchs (shark sand rays) represent a critical component of marine ecosystems. Yet, they are experiencing global population declines and effective monitoring of populations is essential to their protection. Underwater stationary videos, such as those from Baited Remote Underwater Video Stations (BRUVS), are critical for understanding elasmobranch spatial ecology and abundance. However, processing these videos requires time-consuming manual analysis that can delay conservation. To address this challenge, we developed SharkTrack, a semi-automatic underwater video analysis software. SharkTrack uses Convolutional Neural Networks (CNN) and Multi-Object Tracking to automatically detect and track elasmobranchs and provides an annotation pipeline to manually classify elasmobranch species and compute species-specific MaxN (ssMaxN), the standard metric of relative abundance. When tested on BRUVS footage from locations unseen by the CNN model during training, SharkTrack computed ssMaxN with 89% accuracy over 207 hours of footage. The semi-automatic SharkTrack pipeline required two minutes of manual classification per hour of video, an estimated 95% reduction of manual analysis time compared to traditional methods. Furthermore, we demonstrate SharkTrack accuracy across diverse marine ecosystems and elasmobranch species, an advancement compared to previous models, which were limited to specific species or locations. SharkTrack applications extend beyond BRUVS, facilitating the analysis of any underwater stationary video. By making video analysis faster and more accessible, SharkTrack enables research and conservation organisations to monitor elasmobranch populations more efficiently, thereby improving conservation efforts. To further support these goals, we provide public access to the SharkTrack software. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_20623 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | SharkTrack: an accurate, generalisable software for streamlining shark and ray underwater video analysis Varini, Filippo Gayford, Joel H. Jenrette, Jeremy Witt, Matthew J. Garzon, Francesco Ferretti, Francesco Wilday, Sophie Bond, Mark E. Heithaus, Michael R. Robinson, Danielle Carter, Devon Gumbs, Najee Webster, Vincent Glocker, Ben Computer Vision and Pattern Recognition Machine Learning Software Engineering Elasmobranchs (shark sand rays) represent a critical component of marine ecosystems. Yet, they are experiencing global population declines and effective monitoring of populations is essential to their protection. Underwater stationary videos, such as those from Baited Remote Underwater Video Stations (BRUVS), are critical for understanding elasmobranch spatial ecology and abundance. However, processing these videos requires time-consuming manual analysis that can delay conservation. To address this challenge, we developed SharkTrack, a semi-automatic underwater video analysis software. SharkTrack uses Convolutional Neural Networks (CNN) and Multi-Object Tracking to automatically detect and track elasmobranchs and provides an annotation pipeline to manually classify elasmobranch species and compute species-specific MaxN (ssMaxN), the standard metric of relative abundance. When tested on BRUVS footage from locations unseen by the CNN model during training, SharkTrack computed ssMaxN with 89% accuracy over 207 hours of footage. The semi-automatic SharkTrack pipeline required two minutes of manual classification per hour of video, an estimated 95% reduction of manual analysis time compared to traditional methods. Furthermore, we demonstrate SharkTrack accuracy across diverse marine ecosystems and elasmobranch species, an advancement compared to previous models, which were limited to specific species or locations. SharkTrack applications extend beyond BRUVS, facilitating the analysis of any underwater stationary video. By making video analysis faster and more accessible, SharkTrack enables research and conservation organisations to monitor elasmobranch populations more efficiently, thereby improving conservation efforts. To further support these goals, we provide public access to the SharkTrack software. |
| title | SharkTrack: an accurate, generalisable software for streamlining shark and ray underwater video analysis |
| topic | Computer Vision and Pattern Recognition Machine Learning Software Engineering |
| url | https://arxiv.org/abs/2407.20623 |