Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2407.17086 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914885063933952 |
|---|---|
| author | Guo, Yijie Huang, Zhenhan Wang, Ruhan Yao, Zhihao Yu, Tianyu Xu, Zhiling Zhao, Xinyu Li, Xueqing Mi, Haipeng |
| author_facet | Guo, Yijie Huang, Zhenhan Wang, Ruhan Yao, Zhihao Yu, Tianyu Xu, Zhiling Zhao, Xinyu Li, Xueqing Mi, Haipeng |
| contents | While Swarm User Interfaces (SUIs) have succeeded in enriching tangible interaction experiences, their limitations in autonomous action planning have hindered the potential for personalized and dynamic interaction generation in tabletop games. Based on the AI-Gadget Kit we developed, this paper explores how to integrate LLM-driven agents within tabletop games to enable SUIs to execute complex interaction tasks. After defining the design space of this kit, we elucidate the method for designing agents that can extend the meta-actions of SUIs to complex motion planning. Furthermore, we introduce an add-on prompt method that simplifies the design process for four interaction behaviors and four interaction relationships in tabletop games. Lastly, we present several application scenarios that illustrate the potential of AI-Gadget Kit to construct personalized interaction in SUI tabletop games. We expect to use our work as a case study to inspire research on multi-agent-driven SUI for other scenarios with complex interaction tasks. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2407_17086 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | AI-Gadget Kit: Integrating Swarm User Interfaces with LLM-driven Agents for Rich Tabletop Game Applications Guo, Yijie Huang, Zhenhan Wang, Ruhan Yao, Zhihao Yu, Tianyu Xu, Zhiling Zhao, Xinyu Li, Xueqing Mi, Haipeng Human-Computer Interaction While Swarm User Interfaces (SUIs) have succeeded in enriching tangible interaction experiences, their limitations in autonomous action planning have hindered the potential for personalized and dynamic interaction generation in tabletop games. Based on the AI-Gadget Kit we developed, this paper explores how to integrate LLM-driven agents within tabletop games to enable SUIs to execute complex interaction tasks. After defining the design space of this kit, we elucidate the method for designing agents that can extend the meta-actions of SUIs to complex motion planning. Furthermore, we introduce an add-on prompt method that simplifies the design process for four interaction behaviors and four interaction relationships in tabletop games. Lastly, we present several application scenarios that illustrate the potential of AI-Gadget Kit to construct personalized interaction in SUI tabletop games. We expect to use our work as a case study to inspire research on multi-agent-driven SUI for other scenarios with complex interaction tasks. |
| title | AI-Gadget Kit: Integrating Swarm User Interfaces with LLM-driven Agents for Rich Tabletop Game Applications |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2407.17086 |