From Static to Interactive: Authoring Interactive Visualizations via Natural Language

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Liu, Can, Lee, Jaeuk, Chen, Tianhe, Jiang, Zhibang, Wen, Xiaolin, Wang, Yong
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918467132719104
author Liu, Can
Lee, Jaeuk
Chen, Tianhe
Jiang, Zhibang
Wen, Xiaolin
Wang, Yong
author_facet Liu, Can
Lee, Jaeuk
Chen, Tianhe
Jiang, Zhibang
Wen, Xiaolin
Wang, Yong
contents Interactivity is crucial for effective data visualizations. However, it is often challenging to implement interactions for existing static visualizations, since the underlying code and data for existing static visualizations are often not available, and it also takes significant time and effort to enable interactions for them even if the original code and data are available. To fill this gap, we propose Athanor, a novel approach to transform existing static visualizations into interactive ones using multimodal large language models (MLLMs) and natural language instructions. Our approach introduces three key innovations: (1) an action-modification interaction design space that maps visualization interactions into user actions and corresponding adjustments, (2) a multi-agent requirement analyzer that translates natural language instructions into an actionable operational space, and (3) a visualization abstraction transformer that converts static visualizations into flexible and interactive representations regardless of their underlying implementation. Athanor allows users to effortlessly author interactions through natural language instructions, eliminating the need for programming. We conducted two case studies and in-depth interviews with target users to evaluate our approach. The results demonstrate the effectiveness and usability of our approach in allowing users to conveniently enable flexible interactions for static visualizations.
format Preprint
id arxiv_https___arxiv_org_abs_2601_17736
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle From Static to Interactive: Authoring Interactive Visualizations via Natural Language
Liu, Can
Lee, Jaeuk
Chen, Tianhe
Jiang, Zhibang
Wen, Xiaolin
Wang, Yong
Human-Computer Interaction
Artificial Intelligence
Interactivity is crucial for effective data visualizations. However, it is often challenging to implement interactions for existing static visualizations, since the underlying code and data for existing static visualizations are often not available, and it also takes significant time and effort to enable interactions for them even if the original code and data are available. To fill this gap, we propose Athanor, a novel approach to transform existing static visualizations into interactive ones using multimodal large language models (MLLMs) and natural language instructions. Our approach introduces three key innovations: (1) an action-modification interaction design space that maps visualization interactions into user actions and corresponding adjustments, (2) a multi-agent requirement analyzer that translates natural language instructions into an actionable operational space, and (3) a visualization abstraction transformer that converts static visualizations into flexible and interactive representations regardless of their underlying implementation. Athanor allows users to effortlessly author interactions through natural language instructions, eliminating the need for programming. We conducted two case studies and in-depth interviews with target users to evaluate our approach. The results demonstrate the effectiveness and usability of our approach in allowing users to conveniently enable flexible interactions for static visualizations.
title From Static to Interactive: Authoring Interactive Visualizations via Natural Language
topic Human-Computer Interaction
Artificial Intelligence
url https://arxiv.org/abs/2601.17736