CAD-Llama: Leveraging Large Language Models for Computer-Aided Design Parametric 3D Model Generation

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Li, Jiahao, Ma, Weijian, Li, Xueyang, Lou, Yunzhong, Zhou, Guichun, Zhou, Xiangdong
Natura: Preprint
Pubblicazione: 2025
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866918052022452224
author Li, Jiahao
Ma, Weijian
Li, Xueyang
Lou, Yunzhong
Zhou, Guichun
Zhou, Xiangdong
author_facet Li, Jiahao
Ma, Weijian
Li, Xueyang
Lou, Yunzhong
Zhou, Guichun
Zhou, Xiangdong
contents Recently, Large Language Models (LLMs) have achieved significant success, prompting increased interest in expanding their generative capabilities beyond general text into domain-specific areas. This study investigates the generation of parametric sequences for computer-aided design (CAD) models using LLMs. This endeavor represents an initial step towards creating parametric 3D shapes with LLMs, as CAD model parameters directly correlate with shapes in three-dimensional space. Despite the formidable generative capacities of LLMs, this task remains challenging, as these models neither encounter parametric sequences during their pretraining phase nor possess direct awareness of 3D structures. To address this, we present CAD-Llama, a framework designed to enhance pretrained LLMs for generating parametric 3D CAD models. Specifically, we develop a hierarchical annotation pipeline and a code-like format to translate parametric 3D CAD command sequences into Structured Parametric CAD Code (SPCC), incorporating hierarchical semantic descriptions. Furthermore, we propose an adaptive pretraining approach utilizing SPCC, followed by an instruction tuning process aligned with CAD-specific guidelines. This methodology aims to equip LLMs with the spatial knowledge inherent in parametric sequences. Experimental results demonstrate that our framework significantly outperforms prior autoregressive methods and existing LLM baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2505_04481
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle CAD-Llama: Leveraging Large Language Models for Computer-Aided Design Parametric 3D Model Generation
Li, Jiahao
Ma, Weijian
Li, Xueyang
Lou, Yunzhong
Zhou, Guichun
Zhou, Xiangdong
Computer Vision and Pattern Recognition
Recently, Large Language Models (LLMs) have achieved significant success, prompting increased interest in expanding their generative capabilities beyond general text into domain-specific areas. This study investigates the generation of parametric sequences for computer-aided design (CAD) models using LLMs. This endeavor represents an initial step towards creating parametric 3D shapes with LLMs, as CAD model parameters directly correlate with shapes in three-dimensional space. Despite the formidable generative capacities of LLMs, this task remains challenging, as these models neither encounter parametric sequences during their pretraining phase nor possess direct awareness of 3D structures. To address this, we present CAD-Llama, a framework designed to enhance pretrained LLMs for generating parametric 3D CAD models. Specifically, we develop a hierarchical annotation pipeline and a code-like format to translate parametric 3D CAD command sequences into Structured Parametric CAD Code (SPCC), incorporating hierarchical semantic descriptions. Furthermore, we propose an adaptive pretraining approach utilizing SPCC, followed by an instruction tuning process aligned with CAD-specific guidelines. This methodology aims to equip LLMs with the spatial knowledge inherent in parametric sequences. Experimental results demonstrate that our framework significantly outperforms prior autoregressive methods and existing LLM baselines.
title CAD-Llama: Leveraging Large Language Models for Computer-Aided Design Parametric 3D Model Generation
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2505.04481