Analyzing Multimodal Interaction Strategies for LLM-Assisted Manipulation of 3D Scenes
Fuente:
arXiv
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915922255544320 |
|---|---|
| author | Chen, Junlong Grubert, Jens Kristensson, Per Ola |
| author_facet | Chen, Junlong Grubert, Jens Kristensson, Per Ola |
| contents | As more applications of large language models (LLMs) for 3D content for immersive environments emerge, it is crucial to study user behaviour to identify interaction patterns and potential barriers to guide the future design of immersive content creation and editing systems which involve LLMs. In an empirical user study with 12 participants, we combine quantitative usage data with post-experience questionnaire feedback to reveal common interaction patterns and key barriers in LLM-assisted 3D scene editing systems. We identify opportunities for improving natural language interfaces in 3D design tools and propose design recommendations for future LLM-integrated 3D content creation systems. Through an empirical study, we demonstrate that LLM-assisted interactive systems can be used productively in immersive environments. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_22177 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Analyzing Multimodal Interaction Strategies for LLM-Assisted Manipulation of 3D Scenes Chen, Junlong Grubert, Jens Kristensson, Per Ola Human-Computer Interaction Artificial Intelligence As more applications of large language models (LLMs) for 3D content for immersive environments emerge, it is crucial to study user behaviour to identify interaction patterns and potential barriers to guide the future design of immersive content creation and editing systems which involve LLMs. In an empirical user study with 12 participants, we combine quantitative usage data with post-experience questionnaire feedback to reveal common interaction patterns and key barriers in LLM-assisted 3D scene editing systems. We identify opportunities for improving natural language interfaces in 3D design tools and propose design recommendations for future LLM-integrated 3D content creation systems. Through an empirical study, we demonstrate that LLM-assisted interactive systems can be used productively in immersive environments. |
| title | Analyzing Multimodal Interaction Strategies for LLM-Assisted Manipulation of 3D Scenes |
| topic | Human-Computer Interaction Artificial Intelligence |
| url | https://arxiv.org/abs/2410.22177 |