LitVISTA: A Benchmark for Narrative Orchestration in Literary Text

Fuente: arXiv
Salvato in:
Dettagli Bibliografici
Autori principali: Lu, Mingzhe, Wang, Yiwen, Liu, Yanbing, You, Qi, Liu, Chong, Qin, Ruize, Dong, Haoyu, Zhang, Wenyu, Zhang, Jiarui, Hu, Yue, Li, Yunpeng
Natura: Preprint
Pubblicazione: 2026
Soggetti:
Accesso online:
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866914528346767360
author Lu, Mingzhe
Wang, Yiwen
Liu, Yanbing
You, Qi
Liu, Chong
Qin, Ruize
Dong, Haoyu
Zhang, Wenyu
Zhang, Jiarui
Hu, Yue
Li, Yunpeng
author_facet Lu, Mingzhe
Wang, Yiwen
Liu, Yanbing
You, Qi
Liu, Chong
Qin, Ruize
Dong, Haoyu
Zhang, Wenyu
Zhang, Jiarui
Hu, Yue
Li, Yunpeng
contents Computational narrative analysis aims to capture rhythm, tension, and emotional dynamics in literary texts. Existing large language models can generate long stories but overly focus on causal coherence, neglecting the complex story arcs and orchestration inherent in human narratives. This suggests a structural misalignment between model- and human-generated narratives. We therefore position narrative analysis as a diagnostic proxy for generation and propose VISTA Space, a high-dimensional framework for narrative orchestration that unifies human and model perspectives while jointly characterizing narrative function and structure in a common space. We further introduce LitVISTA, a structurally annotated benchmark grounded in literary texts, which operationalizes VISTA Space for systematic evaluation of models' narrative orchestration capabilities. Under an oracle setting with gold event anchors, we evaluate frontier LLMs including GPT, Claude, Grok, and Gemini. Results reveal systematic deficiencies, as current models struggle to jointly capture narrative function and structure and fail to form an integrated global view of literary narrative orchestration. End-to-end analysis further shows that failures are dominated by anchor identification and localization errors. Even advanced thinking modes yield mixed and often limited gains for literary narrative understanding.
format Preprint
id arxiv_https___arxiv_org_abs_2601_06445
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle LitVISTA: A Benchmark for Narrative Orchestration in Literary Text
Lu, Mingzhe
Wang, Yiwen
Liu, Yanbing
You, Qi
Liu, Chong
Qin, Ruize
Dong, Haoyu
Zhang, Wenyu
Zhang, Jiarui
Hu, Yue
Li, Yunpeng
Computation and Language
Artificial Intelligence
Computational narrative analysis aims to capture rhythm, tension, and emotional dynamics in literary texts. Existing large language models can generate long stories but overly focus on causal coherence, neglecting the complex story arcs and orchestration inherent in human narratives. This suggests a structural misalignment between model- and human-generated narratives. We therefore position narrative analysis as a diagnostic proxy for generation and propose VISTA Space, a high-dimensional framework for narrative orchestration that unifies human and model perspectives while jointly characterizing narrative function and structure in a common space. We further introduce LitVISTA, a structurally annotated benchmark grounded in literary texts, which operationalizes VISTA Space for systematic evaluation of models' narrative orchestration capabilities. Under an oracle setting with gold event anchors, we evaluate frontier LLMs including GPT, Claude, Grok, and Gemini. Results reveal systematic deficiencies, as current models struggle to jointly capture narrative function and structure and fail to form an integrated global view of literary narrative orchestration. End-to-end analysis further shows that failures are dominated by anchor identification and localization errors. Even advanced thinking modes yield mixed and often limited gains for literary narrative understanding.
title LitVISTA: A Benchmark for Narrative Orchestration in Literary Text
topic Computation and Language
Artificial Intelligence
url https://arxiv.org/abs/2601.06445