Salvato in:
Dettagli Bibliografici
Autori principali: Schmarje, Lars, Sakman, Kaspar, Koch, Reinhard, Zhang, Dan
Natura: Preprint
Pubblicazione: 2024
Soggetti:
Accesso online:https://arxiv.org/abs/2412.03986
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916508969467904
author Schmarje, Lars
Sakman, Kaspar
Koch, Reinhard
Zhang, Dan
author_facet Schmarje, Lars
Sakman, Kaspar
Koch, Reinhard
Zhang, Dan
contents Autonomous driving (AD) operates in open-world scenarios, where encountering unknown objects is inevitable. However, standard object detectors trained on a limited number of base classes tend to ignore any unknown objects, posing potential risks on the road. To address this, it is important to learn a generic rather than a class specific objectness from objects seen during training. We therefore introduce an occupancy prediction together with bounding box regression. It learns to score the objectness by calculating the ratio of the predicted area occupied by actual objects. To enhance its generalizability, we increase the object diversity by exploiting data from other domains via Mosaic and Mixup augmentation. The objects outside the AD training classes are classified as a newly added out-of-distribution (OOD) class. Our solution UNCOVER, for UNknown Class Object detection for autonomous VEhicles in Real-time, excels at achieving both real-time detection and high recall of unknown objects on challenging AD benchmarks. To further attain very low false positive rates, particularly for close objects, we introduce a post-hoc filtering step that utilizes geometric cues extracted from the depth map, typically available within the AD system.
format Preprint
id arxiv_https___arxiv_org_abs_2412_03986
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle UNCOVER: Unknown Class Object Detection for Autonomous Vehicles in Real-time
Schmarje, Lars
Sakman, Kaspar
Koch, Reinhard
Zhang, Dan
Computer Vision and Pattern Recognition
Autonomous driving (AD) operates in open-world scenarios, where encountering unknown objects is inevitable. However, standard object detectors trained on a limited number of base classes tend to ignore any unknown objects, posing potential risks on the road. To address this, it is important to learn a generic rather than a class specific objectness from objects seen during training. We therefore introduce an occupancy prediction together with bounding box regression. It learns to score the objectness by calculating the ratio of the predicted area occupied by actual objects. To enhance its generalizability, we increase the object diversity by exploiting data from other domains via Mosaic and Mixup augmentation. The objects outside the AD training classes are classified as a newly added out-of-distribution (OOD) class. Our solution UNCOVER, for UNknown Class Object detection for autonomous VEhicles in Real-time, excels at achieving both real-time detection and high recall of unknown objects on challenging AD benchmarks. To further attain very low false positive rates, particularly for close objects, we introduce a post-hoc filtering step that utilizes geometric cues extracted from the depth map, typically available within the AD system.
title UNCOVER: Unknown Class Object Detection for Autonomous Vehicles in Real-time
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2412.03986