MonoCLUE : Object-Aware Clustering Enhances Monocular 3D Object Detection

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Yang, Sunghun, Lee, Minhyeok, Lee, Jungho, Lee, Sangyoun
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909897780625408
author Yang, Sunghun
Lee, Minhyeok
Lee, Jungho
Lee, Sangyoun
author_facet Yang, Sunghun
Lee, Minhyeok
Lee, Jungho
Lee, Sangyoun
contents Monocular 3D object detection offers a cost-effective solution for autonomous driving but suffers from ill-posed depth and limited field of view. These constraints cause a lack of geometric cues and reduced accuracy in occluded or truncated scenes. While recent approaches incorporate additional depth information to address geometric ambiguity, they overlook the visual cues crucial for robust recognition. We propose MonoCLUE, which enhances monocular 3D detection by leveraging both local clustering and generalized scene memory of visual features. First, we perform K-means clustering on visual features to capture distinct object-level appearance parts (e.g., bonnet, car roof), improving detection of partially visible objects. The clustered features are propagated across regions to capture objects with similar appearances. Second, we construct a generalized scene memory by aggregating clustered features across images, providing consistent representations that generalize across scenes. This improves object-level feature consistency, enabling stable detection across varying environments. Lastly, we integrate both local cluster features and generalized scene memory into object queries, guiding attention toward informative regions. Exploiting a unified local clustering and generalized scene memory strategy, MonoCLUE enables robust monocular 3D detection under occlusion and limited visibility, achieving state-of-the-art performance on the KITTI benchmark.
format Preprint
id arxiv_https___arxiv_org_abs_2511_07862
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MonoCLUE : Object-Aware Clustering Enhances Monocular 3D Object Detection
Yang, Sunghun
Lee, Minhyeok
Lee, Jungho
Lee, Sangyoun
Computer Vision and Pattern Recognition
Monocular 3D object detection offers a cost-effective solution for autonomous driving but suffers from ill-posed depth and limited field of view. These constraints cause a lack of geometric cues and reduced accuracy in occluded or truncated scenes. While recent approaches incorporate additional depth information to address geometric ambiguity, they overlook the visual cues crucial for robust recognition. We propose MonoCLUE, which enhances monocular 3D detection by leveraging both local clustering and generalized scene memory of visual features. First, we perform K-means clustering on visual features to capture distinct object-level appearance parts (e.g., bonnet, car roof), improving detection of partially visible objects. The clustered features are propagated across regions to capture objects with similar appearances. Second, we construct a generalized scene memory by aggregating clustered features across images, providing consistent representations that generalize across scenes. This improves object-level feature consistency, enabling stable detection across varying environments. Lastly, we integrate both local cluster features and generalized scene memory into object queries, guiding attention toward informative regions. Exploiting a unified local clustering and generalized scene memory strategy, MonoCLUE enables robust monocular 3D detection under occlusion and limited visibility, achieving state-of-the-art performance on the KITTI benchmark.
title MonoCLUE : Object-Aware Clustering Enhances Monocular 3D Object Detection
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2511.07862