HAMLET: A Hierarchical and Adaptive Multi-Agent Framework for Live Embodied Theatrics

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Jiang, Shufan, Chen, Sizhou, Chen, Chios, Zhang, Chi, Zhang, Xiao-Lei, Li, Xuelong
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911668170129408
author Jiang, Shufan
Chen, Sizhou
Chen, Chios
Zhang, Chi
Zhang, Xiao-Lei
Li, Xuelong
author_facet Jiang, Shufan
Chen, Sizhou
Chen, Chios
Zhang, Chi
Zhang, Xiao-Lei
Li, Xuelong
contents Creating an immersive and interactive theatrical experience is a long-term goal in the field of interactive narrative. The emergence of large language models (LLMs) provides a new path to achieve this goal. However, existing drama generation methods often produce LLMs that lack initiative and cannot interact with the physical scene, while typically requiring detailed input that diminishes the immersion of live performance. To address these challenges, we propose HAMLET, a hierarchical adaptive multi-agent framework focused on drama creation and real-time online performance. Given a simple topic, the framework initially generates a narrative blueprint to guide the subsequent improvisational performance. During online performance, each actor is equipped with an adaptive reasoning module that enables decision-making based on their personas, memories, goals during complex group chat scenarios. Beyond dialogue, actor agents engage in embodied interactions by changing the state of scene props through actions such as opening a letter or picking up a weapon, which are broadcast to update the global environmental context. To objectively assess the quality of live embodied theatrics, we establish a comprehensive evaluation method and introduce HAMLETJudge, a specialized critic model for automated evaluation. Experimental results demonstrate that HAMLET excels in creating expressive, coherent, and physically interactive theatrical experiences in an autonomous manner.
format Preprint
id arxiv_https___arxiv_org_abs_2507_15518
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle HAMLET: A Hierarchical and Adaptive Multi-Agent Framework for Live Embodied Theatrics
Jiang, Shufan
Chen, Sizhou
Chen, Chios
Zhang, Chi
Zhang, Xiao-Lei
Li, Xuelong
Artificial Intelligence
Multiagent Systems
Creating an immersive and interactive theatrical experience is a long-term goal in the field of interactive narrative. The emergence of large language models (LLMs) provides a new path to achieve this goal. However, existing drama generation methods often produce LLMs that lack initiative and cannot interact with the physical scene, while typically requiring detailed input that diminishes the immersion of live performance. To address these challenges, we propose HAMLET, a hierarchical adaptive multi-agent framework focused on drama creation and real-time online performance. Given a simple topic, the framework initially generates a narrative blueprint to guide the subsequent improvisational performance. During online performance, each actor is equipped with an adaptive reasoning module that enables decision-making based on their personas, memories, goals during complex group chat scenarios. Beyond dialogue, actor agents engage in embodied interactions by changing the state of scene props through actions such as opening a letter or picking up a weapon, which are broadcast to update the global environmental context. To objectively assess the quality of live embodied theatrics, we establish a comprehensive evaluation method and introduce HAMLETJudge, a specialized critic model for automated evaluation. Experimental results demonstrate that HAMLET excels in creating expressive, coherent, and physically interactive theatrical experiences in an autonomous manner.
title HAMLET: A Hierarchical and Adaptive Multi-Agent Framework for Live Embodied Theatrics
topic Artificial Intelligence
Multiagent Systems
url https://arxiv.org/abs/2507.15518