MonoGlass3D: Monocular 3D Glass Detection with Plane Regression and Adaptive Feature Fusion

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Zhang, Kai, Zhao, Guoyang, Shi, Jianxing, Liu, Bonan, Qi, Weiqing, Ma, Jun
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914025939402752
author Zhang, Kai
Zhao, Guoyang
Shi, Jianxing
Liu, Bonan
Qi, Weiqing
Ma, Jun
author_facet Zhang, Kai
Zhao, Guoyang
Shi, Jianxing
Liu, Bonan
Qi, Weiqing
Ma, Jun
contents Detecting and localizing glass in 3D environments poses significant challenges for visual perception systems, as the optical properties of glass often hinder conventional sensors from accurately distinguishing glass surfaces. The lack of real-world datasets focused on glass objects further impedes progress in this field. To address this issue, we introduce a new dataset featuring a wide range of glass configurations with precise 3D annotations, collected from distinct real-world scenarios. On the basis of this dataset, we propose MonoGlass3D, a novel approach tailored for monocular 3D glass detection across diverse environments. To overcome the challenges posed by the ambiguous appearance and context diversity of glass, we propose an adaptive feature fusion module that empowers the network to effectively capture contextual information in varying conditions. Additionally, to exploit the distinct planar geometry of glass surfaces, we present a plane regression pipeline, which enables seamless integration of geometric properties within our framework. Extensive experiments demonstrate that our method outperforms state-of-the-art approaches in both glass segmentation and monocular glass depth estimation. Our results highlight the advantages of combining geometric and contextual cues for transparent surface understanding.
format Preprint
id arxiv_https___arxiv_org_abs_2509_05599
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MonoGlass3D: Monocular 3D Glass Detection with Plane Regression and Adaptive Feature Fusion
Zhang, Kai
Zhao, Guoyang
Shi, Jianxing
Liu, Bonan
Qi, Weiqing
Ma, Jun
Robotics
Detecting and localizing glass in 3D environments poses significant challenges for visual perception systems, as the optical properties of glass often hinder conventional sensors from accurately distinguishing glass surfaces. The lack of real-world datasets focused on glass objects further impedes progress in this field. To address this issue, we introduce a new dataset featuring a wide range of glass configurations with precise 3D annotations, collected from distinct real-world scenarios. On the basis of this dataset, we propose MonoGlass3D, a novel approach tailored for monocular 3D glass detection across diverse environments. To overcome the challenges posed by the ambiguous appearance and context diversity of glass, we propose an adaptive feature fusion module that empowers the network to effectively capture contextual information in varying conditions. Additionally, to exploit the distinct planar geometry of glass surfaces, we present a plane regression pipeline, which enables seamless integration of geometric properties within our framework. Extensive experiments demonstrate that our method outperforms state-of-the-art approaches in both glass segmentation and monocular glass depth estimation. Our results highlight the advantages of combining geometric and contextual cues for transparent surface understanding.
title MonoGlass3D: Monocular 3D Glass Detection with Plane Regression and Adaptive Feature Fusion
topic Robotics
url https://arxiv.org/abs/2509.05599