BuildArena: A Physics-Aligned Interactive Benchmark of LLMs for Engineering Construction
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866916026659110912 |
|---|---|
| author | Xia, Tian Gao, Tianrun Deng, Wenhao Wei, Long Qian, Xiaowei Yu, Chenglei Wu, Tailin |
| author_facet | Xia, Tian Gao, Tianrun Deng, Wenhao Wei, Long Qian, Xiaowei Yu, Chenglei Wu, Tailin |
| contents | Engineering construction automation aims to transform natural language specifications into physically viable structures, requiring complex integrated reasoning under strict physical constraints. While modern LLMs possess broad knowledge and strong reasoning capabilities that make them promising candidates for this domain, their construction competencies remain largely unevaluated. To address this gap, we introduce BuildArena, the first physics-aligned interactive benchmark designed for language-driven engineering construction. It takes a first step towards engineering automation using LLMs. Technically, it contributes to the community in two aspects:(1) an extendable task design strategy spanning static and dynamic mechanics across multiple difficulty tiers; (2) a 3D Spatial Geometric Computation Library for supporting construction based on language instructions. On nine frontier LLMs, BuildArena comprehensively evaluates their capabilities for language-driven and physics-grounded construction automation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_16559 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | BuildArena: A Physics-Aligned Interactive Benchmark of LLMs for Engineering Construction Xia, Tian Gao, Tianrun Deng, Wenhao Wei, Long Qian, Xiaowei Yu, Chenglei Wu, Tailin Artificial Intelligence Engineering construction automation aims to transform natural language specifications into physically viable structures, requiring complex integrated reasoning under strict physical constraints. While modern LLMs possess broad knowledge and strong reasoning capabilities that make them promising candidates for this domain, their construction competencies remain largely unevaluated. To address this gap, we introduce BuildArena, the first physics-aligned interactive benchmark designed for language-driven engineering construction. It takes a first step towards engineering automation using LLMs. Technically, it contributes to the community in two aspects:(1) an extendable task design strategy spanning static and dynamic mechanics across multiple difficulty tiers; (2) a 3D Spatial Geometric Computation Library for supporting construction based on language instructions. On nine frontier LLMs, BuildArena comprehensively evaluates their capabilities for language-driven and physics-grounded construction automation. |
| title | BuildArena: A Physics-Aligned Interactive Benchmark of LLMs for Engineering Construction |
| topic | Artificial Intelligence |
| url | https://arxiv.org/abs/2510.16559 |