Tell-XR: Conversational End-User Development of XR Automations

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Carcangiu, Alessandro, Manca, Marco, Mereu, Jacopo, Santoro, Carmen, Simeoli, Ludovica, Spano, Lucio Davide
Format: Preprint
Veröffentlicht: 2025
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866913789766533120
author Carcangiu, Alessandro
Manca, Marco
Mereu, Jacopo
Santoro, Carmen
Simeoli, Ludovica
Spano, Lucio Davide
author_facet Carcangiu, Alessandro
Manca, Marco
Mereu, Jacopo
Santoro, Carmen
Simeoli, Ludovica
Spano, Lucio Davide
contents The availability of extended reality (XR) devices has widened their adoption, yet authoring interactive experiences remains complex for non-programmers. We introduce Tell-XR, an intelligent agent leveraging large language models (LLMs) to guide end-users in defining the interaction in XR settings using automations described as Event-Condition-Action (ECA) rules. Through a formative study, we identified the key conversation stages to define and refine automations, which informed the design of the system architecture. The evaluation study in two scenarios (a VR museum and an AR smart home) demonstrates the effectiveness of Tell-XR across different XR interaction settings.
format Preprint
id arxiv_https___arxiv_org_abs_2504_09104
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Tell-XR: Conversational End-User Development of XR Automations
Carcangiu, Alessandro
Manca, Marco
Mereu, Jacopo
Santoro, Carmen
Simeoli, Ludovica
Spano, Lucio Davide
Human-Computer Interaction
The availability of extended reality (XR) devices has widened their adoption, yet authoring interactive experiences remains complex for non-programmers. We introduce Tell-XR, an intelligent agent leveraging large language models (LLMs) to guide end-users in defining the interaction in XR settings using automations described as Event-Condition-Action (ECA) rules. Through a formative study, we identified the key conversation stages to define and refine automations, which informed the design of the system architecture. The evaluation study in two scenarios (a VR museum and an AR smart home) demonstrates the effectiveness of Tell-XR across different XR interaction settings.
title Tell-XR: Conversational End-User Development of XR Automations
topic Human-Computer Interaction
url https://arxiv.org/abs/2504.09104