STELLA: Guiding Large Language Models for Time Series Forecasting with Semantic Abstractions

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Fan, Junjie, Zhao, Hongye, Wei, Linduo, Rao, Jiayu, Li, Guijia, Yuan, Jiaxin, Xu, Wenqi, Qi, Yong
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866915653952208896
author Fan, Junjie
Zhao, Hongye
Wei, Linduo
Rao, Jiayu
Li, Guijia
Yuan, Jiaxin
Xu, Wenqi
Qi, Yong
author_facet Fan, Junjie
Zhao, Hongye
Wei, Linduo
Rao, Jiayu
Li, Guijia
Yuan, Jiaxin
Xu, Wenqi
Qi, Yong
contents Recent adaptations of Large Language Models (LLMs) for time series forecasting often fail to effectively enhance information for raw series, leaving LLM reasoning capabilities underutilized. Existing prompting strategies rely on static correlations rather than generative interpretations of dynamic behavior, lacking critical global and instance-specific context. To address this, we propose STELLA (Semantic-Temporal Alignment with Language Abstractions), a framework that systematically mines and injects structured supplementary and complementary information. STELLA employs a dynamic semantic abstraction mechanism that decouples input series into trend, seasonality, and residual components. It then translates intrinsic behavioral features of these components into Hierarchical Semantic Anchors: a Corpus-level Semantic Prior (CSP) for global context and a Fine-grained Behavioral Prompt (FBP) for instance-level patterns. Using these anchors as prefix-prompts, STELLA guides the LLM to model intrinsic dynamics. Experiments on eight benchmark datasets demonstrate that STELLA outperforms state-of-the-art methods in long- and short-term forecasting, showing superior generalization in zero-shot and few-shot settings. Ablation studies further validate the effectiveness of our dynamically generated semantic anchors.
format Preprint
id arxiv_https___arxiv_org_abs_2512_04871
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle STELLA: Guiding Large Language Models for Time Series Forecasting with Semantic Abstractions
Fan, Junjie
Zhao, Hongye
Wei, Linduo
Rao, Jiayu
Li, Guijia
Yuan, Jiaxin
Xu, Wenqi
Qi, Yong
Artificial Intelligence
Computation and Language
Machine Learning
Recent adaptations of Large Language Models (LLMs) for time series forecasting often fail to effectively enhance information for raw series, leaving LLM reasoning capabilities underutilized. Existing prompting strategies rely on static correlations rather than generative interpretations of dynamic behavior, lacking critical global and instance-specific context. To address this, we propose STELLA (Semantic-Temporal Alignment with Language Abstractions), a framework that systematically mines and injects structured supplementary and complementary information. STELLA employs a dynamic semantic abstraction mechanism that decouples input series into trend, seasonality, and residual components. It then translates intrinsic behavioral features of these components into Hierarchical Semantic Anchors: a Corpus-level Semantic Prior (CSP) for global context and a Fine-grained Behavioral Prompt (FBP) for instance-level patterns. Using these anchors as prefix-prompts, STELLA guides the LLM to model intrinsic dynamics. Experiments on eight benchmark datasets demonstrate that STELLA outperforms state-of-the-art methods in long- and short-term forecasting, showing superior generalization in zero-shot and few-shot settings. Ablation studies further validate the effectiveness of our dynamically generated semantic anchors.
title STELLA: Guiding Large Language Models for Time Series Forecasting with Semantic Abstractions
topic Artificial Intelligence
Computation and Language
Machine Learning
url https://arxiv.org/abs/2512.04871