UNIT: Unsupervised Online Instance Segmentation through Time
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914947947036672 |
|---|---|
| author | Sautier, Corentin Puy, Gilles Boulch, Alexandre Marlet, Renaud Lepetit, Vincent |
| author_facet | Sautier, Corentin Puy, Gilles Boulch, Alexandre Marlet, Renaud Lepetit, Vincent |
| contents | Online object segmentation and tracking in Lidar point clouds enables autonomous agents to understand their surroundings and make safe decisions. Unfortunately, manual annotations for these tasks are prohibitively costly. We tackle this problem with the task of class-agnostic unsupervised online instance segmentation and tracking. To that end, we leverage an instance segmentation backbone and propose a new training recipe that enables the online tracking of objects. Our network is trained on pseudo-labels, eliminating the need for manual annotations. We conduct an evaluation using metrics adapted for temporal instance segmentation. Computing these metrics requires temporally-consistent instance labels. When unavailable, we construct these labels using the available 3D bounding boxes and semantic labels in the dataset. We compare our method against strong baselines and demonstrate its superiority across two different outdoor Lidar datasets. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2409_07887 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | UNIT: Unsupervised Online Instance Segmentation through Time Sautier, Corentin Puy, Gilles Boulch, Alexandre Marlet, Renaud Lepetit, Vincent Computer Vision and Pattern Recognition Online object segmentation and tracking in Lidar point clouds enables autonomous agents to understand their surroundings and make safe decisions. Unfortunately, manual annotations for these tasks are prohibitively costly. We tackle this problem with the task of class-agnostic unsupervised online instance segmentation and tracking. To that end, we leverage an instance segmentation backbone and propose a new training recipe that enables the online tracking of objects. Our network is trained on pseudo-labels, eliminating the need for manual annotations. We conduct an evaluation using metrics adapted for temporal instance segmentation. Computing these metrics requires temporally-consistent instance labels. When unavailable, we construct these labels using the available 3D bounding boxes and semantic labels in the dataset. We compare our method against strong baselines and demonstrate its superiority across two different outdoor Lidar datasets. |
| title | UNIT: Unsupervised Online Instance Segmentation through Time |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2409.07887 |