StixelNExT: Toward Monocular Low-Weight Perception for Object Segmentation and Free Space Detection
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866915378418941952 |
|---|---|
| author | Vosshans, Marcel Ait-Aider, Omar Mezouar, Youcef Enzweiler, Markus |
| author_facet | Vosshans, Marcel Ait-Aider, Omar Mezouar, Youcef Enzweiler, Markus |
| contents | In this work, we present a novel approach for general object segmentation from a monocular image, eliminating the need for manually labeled training data and enabling rapid, straightforward training and adaptation with minimal data. Our model initially learns from LiDAR during the training process, which is subsequently removed from the system, allowing it to function solely on monocular imagery. This study leverages the concept of the Stixel-World to recognize a medium level representation of its surroundings. Our network directly predicts a 2D multi-layer Stixel-World and is capable of recognizing and locating multiple, superimposed objects within an image. Due to the scarcity of comparable works, we have divided the capabilities into modules and present a free space detection in our experiments section. Furthermore, we introduce an improved method for generating Stixels from LiDAR data, which we use as ground truth for our network. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_08277 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | StixelNExT: Toward Monocular Low-Weight Perception for Object Segmentation and Free Space Detection Vosshans, Marcel Ait-Aider, Omar Mezouar, Youcef Enzweiler, Markus Computer Vision and Pattern Recognition In this work, we present a novel approach for general object segmentation from a monocular image, eliminating the need for manually labeled training data and enabling rapid, straightforward training and adaptation with minimal data. Our model initially learns from LiDAR during the training process, which is subsequently removed from the system, allowing it to function solely on monocular imagery. This study leverages the concept of the Stixel-World to recognize a medium level representation of its surroundings. Our network directly predicts a 2D multi-layer Stixel-World and is capable of recognizing and locating multiple, superimposed objects within an image. Due to the scarcity of comparable works, we have divided the capabilities into modules and present a free space detection in our experiments section. Furthermore, we introduce an improved method for generating Stixels from LiDAR data, which we use as ground truth for our network. |
| title | StixelNExT: Toward Monocular Low-Weight Perception for Object Segmentation and Free Space Detection |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2407.08277 |