Cooperative Design Optimization through Natural Language Interaction

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Niwa, Ryogo, Yoshida, Shigeo, Koyama, Yuki, Ushiku, Yoshitaka
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866909748708769792
author Niwa, Ryogo
Yoshida, Shigeo
Koyama, Yuki
Ushiku, Yoshitaka
author_facet Niwa, Ryogo
Yoshida, Shigeo
Koyama, Yuki
Ushiku, Yoshitaka
contents Designing successful interactions requires identifying optimal design parameters. To do so, designers often conduct iterative user testing and exploratory trial-and-error. This involves balancing multiple objectives in a high-dimensional space, making the process time-consuming and cognitively demanding. System-led optimization methods, such as those based on Bayesian optimization, can determine for designers which parameters to test next. However, they offer limited opportunities for designers to intervene in the optimization process, negatively impacting the designer's experience. We propose a design optimization framework that enables natural language interactions between designers and the optimization system, facilitating cooperative design optimization. This is achieved by integrating system-led optimization methods with Large Language Models (LLMs), allowing designers to intervene in the optimization process and better understand the system's reasoning. Experimental results show that our method provides higher user agency than a system-led method and shows promising optimization performance compared to manual design. It also matches the performance of an existing cooperative method with lower cognitive load.
format Preprint
id arxiv_https___arxiv_org_abs_2508_16077
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Cooperative Design Optimization through Natural Language Interaction
Niwa, Ryogo
Yoshida, Shigeo
Koyama, Yuki
Ushiku, Yoshitaka
Human-Computer Interaction
Artificial Intelligence
Machine Learning
Designing successful interactions requires identifying optimal design parameters. To do so, designers often conduct iterative user testing and exploratory trial-and-error. This involves balancing multiple objectives in a high-dimensional space, making the process time-consuming and cognitively demanding. System-led optimization methods, such as those based on Bayesian optimization, can determine for designers which parameters to test next. However, they offer limited opportunities for designers to intervene in the optimization process, negatively impacting the designer's experience. We propose a design optimization framework that enables natural language interactions between designers and the optimization system, facilitating cooperative design optimization. This is achieved by integrating system-led optimization methods with Large Language Models (LLMs), allowing designers to intervene in the optimization process and better understand the system's reasoning. Experimental results show that our method provides higher user agency than a system-led method and shows promising optimization performance compared to manual design. It also matches the performance of an existing cooperative method with lower cognitive load.
title Cooperative Design Optimization through Natural Language Interaction
topic Human-Computer Interaction
Artificial Intelligence
Machine Learning
url https://arxiv.org/abs/2508.16077