Automating UI Optimization through Multi-Agentic Reasoning

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Li, Zhipeng, Gebhardt, Christoph, Liao, Yi-Chi, Holz, Christian
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912984122523648
author Li, Zhipeng
Gebhardt, Christoph
Liao, Yi-Chi
Holz, Christian
author_facet Li, Zhipeng
Gebhardt, Christoph
Liao, Yi-Chi
Holz, Christian
contents We present AutoOptimization, a novel multi-objective optimization framework for adapting user interfaces. From a user's verbal preferences for changing a UI, our framework guides a prioritization-based Pareto frontier search over candidate layouts. It selects suitable objective functions for UI placement while simultaneously parameterizing them according to the user's instructions to define the optimization problem. A solver then generates a series of optimal UI layouts, which our framework validates against the user's instructions to adapt the UI with the final solution. Our approach thus overcomes the previous need for manual inspection of layouts and the use of population averages for objective parameters. We integrate multiple agents sequentially within our framework, enabling the system to leverage their reasoning capabilities to interpret user preferences, configure the optimization problem, and validate optimization outcomes.
format Preprint
id arxiv_https___arxiv_org_abs_2602_13126
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Automating UI Optimization through Multi-Agentic Reasoning
Li, Zhipeng
Gebhardt, Christoph
Liao, Yi-Chi
Holz, Christian
Human-Computer Interaction
We present AutoOptimization, a novel multi-objective optimization framework for adapting user interfaces. From a user's verbal preferences for changing a UI, our framework guides a prioritization-based Pareto frontier search over candidate layouts. It selects suitable objective functions for UI placement while simultaneously parameterizing them according to the user's instructions to define the optimization problem. A solver then generates a series of optimal UI layouts, which our framework validates against the user's instructions to adapt the UI with the final solution. Our approach thus overcomes the previous need for manual inspection of layouts and the use of population averages for objective parameters. We integrate multiple agents sequentially within our framework, enabling the system to leverage their reasoning capabilities to interpret user preferences, configure the optimization problem, and validate optimization outcomes.
title Automating UI Optimization through Multi-Agentic Reasoning
topic Human-Computer Interaction
url https://arxiv.org/abs/2602.13126