SeqTrack3D: Exploring Sequence Information for Robust 3D Point Cloud Tracking

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Lin, Yu, Li, Zhiheng, Cui, Yubo, Fang, Zheng
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866913244242771968
author Lin, Yu
Li, Zhiheng
Cui, Yubo
Fang, Zheng
author_facet Lin, Yu
Li, Zhiheng
Cui, Yubo
Fang, Zheng
contents 3D single object tracking (SOT) is an important and challenging task for the autonomous driving and mobile robotics. Most existing methods perform tracking between two consecutive frames while ignoring the motion patterns of the target over a series of frames, which would cause performance degradation in the scenes with sparse points. To break through this limitation, we introduce Sequence-to-Sequence tracking paradigm and a tracker named SeqTrack3D to capture target motion across continuous frames. Unlike previous methods that primarily adopted three strategies: matching two consecutive point clouds, predicting relative motion, or utilizing sequential point clouds to address feature degradation, our SeqTrack3D combines both historical point clouds and bounding box sequences. This novel method ensures robust tracking by leveraging location priors from historical boxes, even in scenes with sparse points. Extensive experiments conducted on large-scale datasets show that SeqTrack3D achieves new state-of-the-art performances, improving by 6.00% on NuScenes and 14.13% on Waymo dataset. The code will be made public at https://github.com/aron-lin/seqtrack3d.
format Preprint
id arxiv_https___arxiv_org_abs_2402_16249
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle SeqTrack3D: Exploring Sequence Information for Robust 3D Point Cloud Tracking
Lin, Yu
Li, Zhiheng
Cui, Yubo
Fang, Zheng
Computer Vision and Pattern Recognition
3D single object tracking (SOT) is an important and challenging task for the autonomous driving and mobile robotics. Most existing methods perform tracking between two consecutive frames while ignoring the motion patterns of the target over a series of frames, which would cause performance degradation in the scenes with sparse points. To break through this limitation, we introduce Sequence-to-Sequence tracking paradigm and a tracker named SeqTrack3D to capture target motion across continuous frames. Unlike previous methods that primarily adopted three strategies: matching two consecutive point clouds, predicting relative motion, or utilizing sequential point clouds to address feature degradation, our SeqTrack3D combines both historical point clouds and bounding box sequences. This novel method ensures robust tracking by leveraging location priors from historical boxes, even in scenes with sparse points. Extensive experiments conducted on large-scale datasets show that SeqTrack3D achieves new state-of-the-art performances, improving by 6.00% on NuScenes and 14.13% on Waymo dataset. The code will be made public at https://github.com/aron-lin/seqtrack3d.
title SeqTrack3D: Exploring Sequence Information for Robust 3D Point Cloud Tracking
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2402.16249