Saved in:
Bibliographic Details
Main Authors: Kulits, Peter, Schmid, Cordelia
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.22984
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866914506409508864
author Kulits, Peter
Schmid, Cordelia
author_facet Kulits, Peter
Schmid, Cordelia
contents We train a language model to generate LEGO-brick build sequences. While prior work has been restricted to discrete, voxel-like towers, we consider a much broader set of pieces, encompassing thousands of part types with diverse connection semantics. To enable this, we first collect a large-scale dataset of over 100,000 human-designed LDraw brick objects and scenes. The complexity of our setting makes it challenging to autoregressively assemble structures that satisfy physical constraints. When predicting block pose directly, build sequences quickly become invalid after a small number of steps. Although pieces are placed in 3D space, it is the spatial relationships of the parts which define the whole. With this in mind, we design a graph-based program representation that parametrizes structure through connectivity, improving the physical grounding of generated sequences. To enable future applications, we make our dataset and models available for research purposes. https://kulits.github.io/BrickNet
format Preprint
id arxiv_https___arxiv_org_abs_2604_22984
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle BrickNet: Graph-Backed Generative Brick Assembly
Kulits, Peter
Schmid, Cordelia
Computer Vision and Pattern Recognition
Graphics
We train a language model to generate LEGO-brick build sequences. While prior work has been restricted to discrete, voxel-like towers, we consider a much broader set of pieces, encompassing thousands of part types with diverse connection semantics. To enable this, we first collect a large-scale dataset of over 100,000 human-designed LDraw brick objects and scenes. The complexity of our setting makes it challenging to autoregressively assemble structures that satisfy physical constraints. When predicting block pose directly, build sequences quickly become invalid after a small number of steps. Although pieces are placed in 3D space, it is the spatial relationships of the parts which define the whole. With this in mind, we design a graph-based program representation that parametrizes structure through connectivity, improving the physical grounding of generated sequences. To enable future applications, we make our dataset and models available for research purposes. https://kulits.github.io/BrickNet
title BrickNet: Graph-Backed Generative Brick Assembly
topic Computer Vision and Pattern Recognition
Graphics
url https://arxiv.org/abs/2604.22984