Saved in:
Bibliographic Details
Main Authors: Lukezic, Alan, Trojer, Ziga, Matas, Jiri, Kristan, Matej
Format: Preprint
Published: 2024
Subjects:
Online Access:https://arxiv.org/abs/2401.03872
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866929202545033216
author Lukezic, Alan
Trojer, Ziga
Matas, Jiri
Kristan, Matej
author_facet Lukezic, Alan
Trojer, Ziga
Matas, Jiri
Kristan, Matej
contents Performance of modern trackers degrades substantially on transparent objects compared to opaque objects. This is largely due to two distinct reasons. Transparent objects are unique in that their appearance is directly affected by the background. Furthermore, transparent object scenes often contain many visually similar objects (distractors), which often lead to tracking failure. However, development of modern tracking architectures requires large training sets, which do not exist in transparent object tracking. We present two contributions addressing the aforementioned issues. We propose the first transparent object tracking training dataset Trans2k that consists of over 2k sequences with 104,343 images overall, annotated by bounding boxes and segmentation masks. Standard trackers trained on this dataset consistently improve by up to 16%. Our second contribution is a new distractor-aware transparent object tracker (DiTra) that treats localization accuracy and target identification as separate tasks and implements them by a novel architecture. DiTra sets a new state-of-the-art in transparent object tracking and generalizes well to opaque objects.
format Preprint
id arxiv_https___arxiv_org_abs_2401_03872
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle A New Dataset and a Distractor-Aware Architecture for Transparent Object Tracking
Lukezic, Alan
Trojer, Ziga
Matas, Jiri
Kristan, Matej
Computer Vision and Pattern Recognition
Performance of modern trackers degrades substantially on transparent objects compared to opaque objects. This is largely due to two distinct reasons. Transparent objects are unique in that their appearance is directly affected by the background. Furthermore, transparent object scenes often contain many visually similar objects (distractors), which often lead to tracking failure. However, development of modern tracking architectures requires large training sets, which do not exist in transparent object tracking. We present two contributions addressing the aforementioned issues. We propose the first transparent object tracking training dataset Trans2k that consists of over 2k sequences with 104,343 images overall, annotated by bounding boxes and segmentation masks. Standard trackers trained on this dataset consistently improve by up to 16%. Our second contribution is a new distractor-aware transparent object tracker (DiTra) that treats localization accuracy and target identification as separate tasks and implements them by a novel architecture. DiTra sets a new state-of-the-art in transparent object tracking and generalizes well to opaque objects.
title A New Dataset and a Distractor-Aware Architecture for Transparent Object Tracking
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2401.03872