When Trackers Date Fish: A Benchmark and Framework for Underwater Multiple Fish Tracking

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Li, Weiran, Liu, Yeqiang, Guo, Qiannan, Wei, Yijie, Leo, Hwa Liang, Li, Zhenbo
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866908678136791040
author Li, Weiran
Liu, Yeqiang
Guo, Qiannan
Wei, Yijie
Leo, Hwa Liang
Li, Zhenbo
author_facet Li, Weiran
Liu, Yeqiang
Guo, Qiannan
Wei, Yijie
Leo, Hwa Liang
Li, Zhenbo
contents Multiple object tracking (MOT) technology has made significant progress in terrestrial applications, but underwater tracking scenarios remain underexplored despite their importance to marine ecology and aquaculture. In this paper, we present Multiple Fish Tracking Dataset 2025 (MFT25), a comprehensive dataset specifically designed for underwater multiple fish tracking, featuring 15 diverse video sequences with 408,578 meticulously annotated bounding boxes across 48,066 frames. Our dataset captures various underwater environments, fish species, and challenging conditions including occlusions, similar appearances, and erratic motion patterns. Additionally, we introduce Scale-aware and Unscented Tracker (SU-T), a specialized tracking framework featuring an Unscented Kalman Filter (UKF) optimized for non-linear swimming patterns of fish and a novel Fish-Intersection-over-Union (FishIoU) matching that accounts for the unique morphological characteristics of aquatic species. Extensive experiments demonstrate that our SU-T baseline achieves state-of-the-art performance on MFT25, with 34.1 HOTA and 44.6 IDF1, while revealing fundamental differences between fish tracking and terrestrial object tracking scenarios. The dataset and codes are released at https://vranlee.github.io/SU-T/.
format Preprint
id arxiv_https___arxiv_org_abs_2507_06400
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle When Trackers Date Fish: A Benchmark and Framework for Underwater Multiple Fish Tracking
Li, Weiran
Liu, Yeqiang
Guo, Qiannan
Wei, Yijie
Leo, Hwa Liang
Li, Zhenbo
Computer Vision and Pattern Recognition
Multiple object tracking (MOT) technology has made significant progress in terrestrial applications, but underwater tracking scenarios remain underexplored despite their importance to marine ecology and aquaculture. In this paper, we present Multiple Fish Tracking Dataset 2025 (MFT25), a comprehensive dataset specifically designed for underwater multiple fish tracking, featuring 15 diverse video sequences with 408,578 meticulously annotated bounding boxes across 48,066 frames. Our dataset captures various underwater environments, fish species, and challenging conditions including occlusions, similar appearances, and erratic motion patterns. Additionally, we introduce Scale-aware and Unscented Tracker (SU-T), a specialized tracking framework featuring an Unscented Kalman Filter (UKF) optimized for non-linear swimming patterns of fish and a novel Fish-Intersection-over-Union (FishIoU) matching that accounts for the unique morphological characteristics of aquatic species. Extensive experiments demonstrate that our SU-T baseline achieves state-of-the-art performance on MFT25, with 34.1 HOTA and 44.6 IDF1, while revealing fundamental differences between fish tracking and terrestrial object tracking scenarios. The dataset and codes are released at https://vranlee.github.io/SU-T/.
title When Trackers Date Fish: A Benchmark and Framework for Underwater Multiple Fish Tracking
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2507.06400