Text-Enhanced Panoptic Symbol Spotting in CAD Drawings

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Liu, Xianlin, Gong, Yan, Li, Bohao, Huang, Jiajing, Du, Bowen, Ye, Junchen, Xu, Liyan
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866909841085169664
author Liu, Xianlin
Gong, Yan
Li, Bohao
Huang, Jiajing
Du, Bowen
Ye, Junchen
Xu, Liyan
author_facet Liu, Xianlin
Gong, Yan
Li, Bohao
Huang, Jiajing
Du, Bowen
Ye, Junchen
Xu, Liyan
contents With the widespread adoption of Computer-Aided Design(CAD) drawings in engineering, architecture, and industrial design, the ability to accurately interpret and analyze these drawings has become increasingly critical. Among various subtasks, panoptic symbol spotting plays a vital role in enabling downstream applications such as CAD automation and design retrieval. Existing methods primarily focus on geometric primitives within the CAD drawings to address this task, but they face following major problems: they usually overlook the rich textual annotations present in CAD drawings and they lack explicit modeling of relationships among primitives, resulting in incomprehensive understanding of the holistic drawings. To fill this gap, we propose a panoptic symbol spotting framework that incorporates textual annotations. The framework constructs unified representations by jointly modeling geometric and textual primitives. Then, using visual features extract by pretrained CNN as the initial representations, a Transformer-based backbone is employed, enhanced with a type-aware attention mechanism to explicitly model the different types of spatial dependencies between various primitives. Extensive experiments on the real-world dataset demonstrate that the proposed method outperforms existing approaches on symbol spotting tasks involving textual annotations, and exhibits superior robustness when applied to complex CAD drawings.
format Preprint
id arxiv_https___arxiv_org_abs_2510_11091
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Text-Enhanced Panoptic Symbol Spotting in CAD Drawings
Liu, Xianlin
Gong, Yan
Li, Bohao
Huang, Jiajing
Du, Bowen
Ye, Junchen
Xu, Liyan
Computer Vision and Pattern Recognition
Artificial Intelligence
With the widespread adoption of Computer-Aided Design(CAD) drawings in engineering, architecture, and industrial design, the ability to accurately interpret and analyze these drawings has become increasingly critical. Among various subtasks, panoptic symbol spotting plays a vital role in enabling downstream applications such as CAD automation and design retrieval. Existing methods primarily focus on geometric primitives within the CAD drawings to address this task, but they face following major problems: they usually overlook the rich textual annotations present in CAD drawings and they lack explicit modeling of relationships among primitives, resulting in incomprehensive understanding of the holistic drawings. To fill this gap, we propose a panoptic symbol spotting framework that incorporates textual annotations. The framework constructs unified representations by jointly modeling geometric and textual primitives. Then, using visual features extract by pretrained CNN as the initial representations, a Transformer-based backbone is employed, enhanced with a type-aware attention mechanism to explicitly model the different types of spatial dependencies between various primitives. Extensive experiments on the real-world dataset demonstrate that the proposed method outperforms existing approaches on symbol spotting tasks involving textual annotations, and exhibits superior robustness when applied to complex CAD drawings.
title Text-Enhanced Panoptic Symbol Spotting in CAD Drawings
topic Computer Vision and Pattern Recognition
Artificial Intelligence
url https://arxiv.org/abs/2510.11091