Bridging Gulfs in UI Generation through Semantic Guidance
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866908822169190400 |
|---|---|
| author | Park, Seokhyeon Lee, Soohyun Choi, Eugene Kim, Hyunwoo Kweon, Minkyu Song, Yumin Seo, Jinwook |
| author_facet | Park, Seokhyeon Lee, Soohyun Choi, Eugene Kim, Hyunwoo Kweon, Minkyu Song, Yumin Seo, Jinwook |
| contents | While generative AI enables high-fidelity UI generation from text prompts, users struggle to articulate design intent and evaluate or refine results-creating gulfs of execution and evaluation. To understand the information needed for UI generation, we conducted a thematic analysis of UI prompting guidelines, identifying key design semantics and discovering that they are hierarchical and interdependent. Leveraging these findings, we developed a system that enables users to specify semantics, visualize relationships, and extract how semantics are reflected in generated UIs. By making semantics serve as an intermediate representation between human intent and AI output, our system bridges both gulfs by making requirements explicit and outcomes interpretable. A comparative user study suggests that our approach enhances users' perceived control over intent expression and outcome interpretation, and facilitates more predictable iterative refinement. Our work demonstrates how explicit semantic representation enables systematic and explainable exploration of design possibilities in AI-driven UI design. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2601_19171 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Bridging Gulfs in UI Generation through Semantic Guidance Park, Seokhyeon Lee, Soohyun Choi, Eugene Kim, Hyunwoo Kweon, Minkyu Song, Yumin Seo, Jinwook Human-Computer Interaction Artificial Intelligence While generative AI enables high-fidelity UI generation from text prompts, users struggle to articulate design intent and evaluate or refine results-creating gulfs of execution and evaluation. To understand the information needed for UI generation, we conducted a thematic analysis of UI prompting guidelines, identifying key design semantics and discovering that they are hierarchical and interdependent. Leveraging these findings, we developed a system that enables users to specify semantics, visualize relationships, and extract how semantics are reflected in generated UIs. By making semantics serve as an intermediate representation between human intent and AI output, our system bridges both gulfs by making requirements explicit and outcomes interpretable. A comparative user study suggests that our approach enhances users' perceived control over intent expression and outcome interpretation, and facilitates more predictable iterative refinement. Our work demonstrates how explicit semantic representation enables systematic and explainable exploration of design possibilities in AI-driven UI design. |
| title | Bridging Gulfs in UI Generation through Semantic Guidance |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2601.19171 |