CinemaWorld: Generative Augmented Reality with LLMs and 3D Scene Generation for Movie Augmentation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2026
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866911498765336576 |
|---|---|
| author | Ihara, Keiichi Lee, DaeHo Abe, Manato Jo, Hye-Young Suzuki, Ryo |
| author_facet | Ihara, Keiichi Lee, DaeHo Abe, Manato Jo, Hye-Young Suzuki, Ryo |
| contents | We introduce CinemaWorld, a generative augmented reality system that augments the viewer's physical surroundings with automatically generated mixed reality 3D content extracted from and synchronized with 2D movie scenes. Our system preprocesses films to extract key features using multimodal large language models (LLMs), generates dynamic 3D augmentations with generative AI, and embeds them spatially into the viewer's physical environment on the Meta Quest 3. To explore the design space of CinemaWorld, we conducted an elicitation study with eight film students, which led us to identify several key augmentation types, including particle effects, surrounding objects, textural overlays, character-driven augmentation, and lighting effects. We evaluated our system through a technical evaluation (N=100 video clips), a user study (N=12), and expert interviews with film creators (N=8). Results indicate that CinemaWorld enhances immersion and enjoyment, suggesting its potential to enrich the film-viewing experience. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2603_08060 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | CinemaWorld: Generative Augmented Reality with LLMs and 3D Scene Generation for Movie Augmentation Ihara, Keiichi Lee, DaeHo Abe, Manato Jo, Hye-Young Suzuki, Ryo Human-Computer Interaction We introduce CinemaWorld, a generative augmented reality system that augments the viewer's physical surroundings with automatically generated mixed reality 3D content extracted from and synchronized with 2D movie scenes. Our system preprocesses films to extract key features using multimodal large language models (LLMs), generates dynamic 3D augmentations with generative AI, and embeds them spatially into the viewer's physical environment on the Meta Quest 3. To explore the design space of CinemaWorld, we conducted an elicitation study with eight film students, which led us to identify several key augmentation types, including particle effects, surrounding objects, textural overlays, character-driven augmentation, and lighting effects. We evaluated our system through a technical evaluation (N=100 video clips), a user study (N=12), and expert interviews with film creators (N=8). Results indicate that CinemaWorld enhances immersion and enjoyment, suggesting its potential to enrich the film-viewing experience. |
| title | CinemaWorld: Generative Augmented Reality with LLMs and 3D Scene Generation for Movie Augmentation |
| topic | Human-Computer Interaction |
| url | https://arxiv.org/abs/2603.08060 |