Piloting Planetarium Visualizations with LLMs during Live Events in Science Centers

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Brossier, Mathis, Jawad, Mujtaba Fadhil, Broman, Emma, Selling, Ylva, Hallsten, Julia, Bock, Alexander, Björklund, Johanna, Isenberg, Tobias, Ynnerman, Anders, Romero, Mario, Besançon, Lonni
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866911410678661120
author Brossier, Mathis
Jawad, Mujtaba Fadhil
Broman, Emma
Selling, Ylva
Hallsten, Julia
Bock, Alexander
Björklund, Johanna
Isenberg, Tobias
Ynnerman, Anders
Romero, Mario
Besançon, Lonni
author_facet Brossier, Mathis
Jawad, Mujtaba Fadhil
Broman, Emma
Selling, Ylva
Hallsten, Julia
Bock, Alexander
Björklund, Johanna
Isenberg, Tobias
Ynnerman, Anders
Romero, Mario
Besançon, Lonni
contents We designed and evaluated an AI pilot in a planetarium visualization software, OpenSpace, for public shows in science centers. The piloting role is usually given to a human working in close collaboration with the guide on stage. We recruited 7 professional guides with extensive experience in giving shows to the public to study the impact of the AI-piloting on the overall experience. The AI-pilot is a conversational AI-agent listening to the guide and interpreting the verbal statements as commands to execute camera motions, change simulation time, or toggle visual assets. Our results show that, while AI pilots lack several critical skills for live shows, they could become useful as co-pilots to reduce workload of human pilots and allow multitasking. We propose research directions toward implementing visualization pilots and co-pilots in live settings.
format Preprint
id arxiv_https___arxiv_org_abs_2601_20466
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Piloting Planetarium Visualizations with LLMs during Live Events in Science Centers
Brossier, Mathis
Jawad, Mujtaba Fadhil
Broman, Emma
Selling, Ylva
Hallsten, Julia
Bock, Alexander
Björklund, Johanna
Isenberg, Tobias
Ynnerman, Anders
Romero, Mario
Besançon, Lonni
Human-Computer Interaction
We designed and evaluated an AI pilot in a planetarium visualization software, OpenSpace, for public shows in science centers. The piloting role is usually given to a human working in close collaboration with the guide on stage. We recruited 7 professional guides with extensive experience in giving shows to the public to study the impact of the AI-piloting on the overall experience. The AI-pilot is a conversational AI-agent listening to the guide and interpreting the verbal statements as commands to execute camera motions, change simulation time, or toggle visual assets. Our results show that, while AI pilots lack several critical skills for live shows, they could become useful as co-pilots to reduce workload of human pilots and allow multitasking. We propose research directions toward implementing visualization pilots and co-pilots in live settings.
title Piloting Planetarium Visualizations with LLMs during Live Events in Science Centers
topic Human-Computer Interaction
url https://arxiv.org/abs/2601.20466