GeoCAD: Local Geometry-Controllable CAD Generation with Large Language Models

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Zhang, Zhanwei, Liu, Kaiyuan, Liu, Junjie, Wang, Wenxiao, Lin, Binbin, Xie, Liang, Shen, Chen, Cai, Deng
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866917025590280192
author Zhang, Zhanwei
Liu, Kaiyuan
Liu, Junjie
Wang, Wenxiao
Lin, Binbin
Xie, Liang
Shen, Chen
Cai, Deng
author_facet Zhang, Zhanwei
Liu, Kaiyuan
Liu, Junjie
Wang, Wenxiao
Lin, Binbin
Xie, Liang
Shen, Chen
Cai, Deng
contents Local geometry-controllable computer-aided design (CAD) generation aims to modify local parts of CAD models automatically, enhancing design efficiency. It also ensures that the shapes of newly generated local parts follow user-specific geometric instructions (e.g., an isosceles right triangle or a rectangle with one corner cut off). However, existing methods encounter challenges in achieving this goal. Specifically, they either lack the ability to follow textual instructions or are unable to focus on the local parts. To address this limitation, we introduce GeoCAD, a user-friendly and local geometry-controllable CAD generation method. Specifically, we first propose a complementary captioning strategy to generate geometric instructions for local parts. This strategy involves vertex-based and VLLM-based captioning for systematically annotating simple and complex parts, respectively. In this way, we caption $\sim$221k different local parts in total. In the training stage, given a CAD model, we randomly mask a local part. Then, using its geometric instruction and the remaining parts as input, we prompt large language models (LLMs) to predict the masked part. During inference, users can specify any local part for modification while adhering to a variety of predefined geometric instructions. Extensive experiments demonstrate the effectiveness of GeoCAD in generation quality, validity and text-to-CAD consistency. Code will be available at https://github.com/Zhanwei-Z/GeoCAD.
format Preprint
id arxiv_https___arxiv_org_abs_2506_10337
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle GeoCAD: Local Geometry-Controllable CAD Generation with Large Language Models
Zhang, Zhanwei
Liu, Kaiyuan
Liu, Junjie
Wang, Wenxiao
Lin, Binbin
Xie, Liang
Shen, Chen
Cai, Deng
Computer Vision and Pattern Recognition
Local geometry-controllable computer-aided design (CAD) generation aims to modify local parts of CAD models automatically, enhancing design efficiency. It also ensures that the shapes of newly generated local parts follow user-specific geometric instructions (e.g., an isosceles right triangle or a rectangle with one corner cut off). However, existing methods encounter challenges in achieving this goal. Specifically, they either lack the ability to follow textual instructions or are unable to focus on the local parts. To address this limitation, we introduce GeoCAD, a user-friendly and local geometry-controllable CAD generation method. Specifically, we first propose a complementary captioning strategy to generate geometric instructions for local parts. This strategy involves vertex-based and VLLM-based captioning for systematically annotating simple and complex parts, respectively. In this way, we caption $\sim$221k different local parts in total. In the training stage, given a CAD model, we randomly mask a local part. Then, using its geometric instruction and the remaining parts as input, we prompt large language models (LLMs) to predict the masked part. During inference, users can specify any local part for modification while adhering to a variety of predefined geometric instructions. Extensive experiments demonstrate the effectiveness of GeoCAD in generation quality, validity and text-to-CAD consistency. Code will be available at https://github.com/Zhanwei-Z/GeoCAD.
title GeoCAD: Local Geometry-Controllable CAD Generation with Large Language Models
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2506.10337