YOLO11-JDE: Fast and Accurate Multi-Object Tracking with Self-Supervised Re-ID

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Erregue, Iñaki, Nasrollahi, Kamal, Escalera, Sergio
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915306833707008
author Erregue, Iñaki
Nasrollahi, Kamal
Escalera, Sergio
author_facet Erregue, Iñaki
Nasrollahi, Kamal
Escalera, Sergio
contents We introduce YOLO11-JDE, a fast and accurate multi-object tracking (MOT) solution that combines real-time object detection with self-supervised Re-Identification (Re-ID). By incorporating a dedicated Re-ID branch into YOLO11s, our model performs Joint Detection and Embedding (JDE), generating appearance features for each detection. The Re-ID branch is trained in a fully self-supervised setting while simultaneously training for detection, eliminating the need for costly identity-labeled datasets. The triplet loss, with hard positive and semi-hard negative mining strategies, is used for learning discriminative embeddings. Data association is enhanced with a custom tracking implementation that successfully integrates motion, appearance, and location cues. YOLO11-JDE achieves competitive results on MOT17 and MOT20 benchmarks, surpassing existing JDE methods in terms of FPS and using up to ten times fewer parameters. Thus, making our method a highly attractive solution for real-world applications.
format Preprint
id arxiv_https___arxiv_org_abs_2501_13710
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle YOLO11-JDE: Fast and Accurate Multi-Object Tracking with Self-Supervised Re-ID
Erregue, Iñaki
Nasrollahi, Kamal
Escalera, Sergio
Computer Vision and Pattern Recognition
Artificial Intelligence
We introduce YOLO11-JDE, a fast and accurate multi-object tracking (MOT) solution that combines real-time object detection with self-supervised Re-Identification (Re-ID). By incorporating a dedicated Re-ID branch into YOLO11s, our model performs Joint Detection and Embedding (JDE), generating appearance features for each detection. The Re-ID branch is trained in a fully self-supervised setting while simultaneously training for detection, eliminating the need for costly identity-labeled datasets. The triplet loss, with hard positive and semi-hard negative mining strategies, is used for learning discriminative embeddings. Data association is enhanced with a custom tracking implementation that successfully integrates motion, appearance, and location cues. YOLO11-JDE achieves competitive results on MOT17 and MOT20 benchmarks, surpassing existing JDE methods in terms of FPS and using up to ten times fewer parameters. Thus, making our method a highly attractive solution for real-world applications.
title YOLO11-JDE: Fast and Accurate Multi-Object Tracking with Self-Supervised Re-ID
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2501.13710