On AI-Inspired UI-Design

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Wei, Jialiang, Courbis, Anne-Lise, Lambolais, Thomas, Dray, Gérard, Maalej, Walid
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866929688436277248
author Wei, Jialiang
Courbis, Anne-Lise
Lambolais, Thomas
Dray, Gérard
Maalej, Walid
author_facet Wei, Jialiang
Courbis, Anne-Lise
Lambolais, Thomas
Dray, Gérard
Maalej, Walid
contents Graphical User Interface (or simply UI) is a primary mean of interaction between users and their devices. In this paper, we discuss three complementary Artificial Intelligence (AI) approaches for triggering the creativity of app designers and inspiring them create better and more diverse UI designs. First, designers can prompt a Large Language Model (LLM) to directly generate and adjust UIs. Second, a Vision-Language Model (VLM) enables designers to effectively search a large screenshot dataset, e.g. from apps published in app stores. Third, a Diffusion Model (DM) can be trained to specifically generate UIs as inspirational images. We present an AI-inspired design process and discuss the implications and limitations of the approaches.
format Preprint
id arxiv_https___arxiv_org_abs_2406_13631
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle On AI-Inspired UI-Design
Wei, Jialiang
Courbis, Anne-Lise
Lambolais, Thomas
Dray, Gérard
Maalej, Walid
Human-Computer Interaction
Artificial Intelligence
Software Engineering
Graphical User Interface (or simply UI) is a primary mean of interaction between users and their devices. In this paper, we discuss three complementary Artificial Intelligence (AI) approaches for triggering the creativity of app designers and inspiring them create better and more diverse UI designs. First, designers can prompt a Large Language Model (LLM) to directly generate and adjust UIs. Second, a Vision-Language Model (VLM) enables designers to effectively search a large screenshot dataset, e.g. from apps published in app stores. Third, a Diffusion Model (DM) can be trained to specifically generate UIs as inspirational images. We present an AI-inspired design process and discuss the implications and limitations of the approaches.
title On AI-Inspired UI-Design
topic Human-Computer Interaction
Artificial Intelligence
Software Engineering
url https://arxiv.org/abs/2406.13631