Closing the Loop: A Control-Theoretic Framework for Provably Stable Time Series Forecasting with LLMs

Fuente: arXiv
Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zhang, Xingyu, Du, Hanyun, Song, Zeen, Zhang, Jianqi, Zheng, Changwen, Qiang, Wenwen
Format: Preprint
Veröffentlicht: 2026
Schlagworte:
Online-Zugang:
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
_version_ 1866914327870570496
author Zhang, Xingyu
Du, Hanyun
Song, Zeen
Zhang, Jianqi
Zheng, Changwen
Qiang, Wenwen
author_facet Zhang, Xingyu
Du, Hanyun
Song, Zeen
Zhang, Jianqi
Zheng, Changwen
Qiang, Wenwen
contents Large Language Models (LLMs) have recently shown exceptional potential in time series forecasting, leveraging their inherent sequential reasoning capabilities to model complex temporal dynamics. However, existing approaches typically employ a naive autoregressive generation strategy. We identify a critical theoretical flaw in this paradigm: during inference, the model operates in an open-loop manner, consuming its own generated outputs recursively. This leads to inevitable error accumulation (exposure bias), where minor early deviations cascade into significant trajectory drift over long horizons. In this paper, we reformulate autoregressive forecasting through the lens of control theory, proposing \textbf{F-LLM} (Feedback-driven LLM), a novel closed-loop framework. Unlike standard methods that passively propagate errors, F-LLM actively stabilizes the trajectory via a learnable residual estimator (Observer) and a feedback controller. Furthermore, we provide a theoretical guarantee that our closed-loop mechanism ensures uniformly bounded error, provided the base model satisfies a local Lipschitz constraint. Extensive experiments demonstrate that F-LLM significantly mitigates error propagation, achieving good performance on time series benchmarks.
format Preprint
id arxiv_https___arxiv_org_abs_2602_12756
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Closing the Loop: A Control-Theoretic Framework for Provably Stable Time Series Forecasting with LLMs
Zhang, Xingyu
Du, Hanyun
Song, Zeen
Zhang, Jianqi
Zheng, Changwen
Qiang, Wenwen
Machine Learning
Large Language Models (LLMs) have recently shown exceptional potential in time series forecasting, leveraging their inherent sequential reasoning capabilities to model complex temporal dynamics. However, existing approaches typically employ a naive autoregressive generation strategy. We identify a critical theoretical flaw in this paradigm: during inference, the model operates in an open-loop manner, consuming its own generated outputs recursively. This leads to inevitable error accumulation (exposure bias), where minor early deviations cascade into significant trajectory drift over long horizons. In this paper, we reformulate autoregressive forecasting through the lens of control theory, proposing \textbf{F-LLM} (Feedback-driven LLM), a novel closed-loop framework. Unlike standard methods that passively propagate errors, F-LLM actively stabilizes the trajectory via a learnable residual estimator (Observer) and a feedback controller. Furthermore, we provide a theoretical guarantee that our closed-loop mechanism ensures uniformly bounded error, provided the base model satisfies a local Lipschitz constraint. Extensive experiments demonstrate that F-LLM significantly mitigates error propagation, achieving good performance on time series benchmarks.
title Closing the Loop: A Control-Theoretic Framework for Provably Stable Time Series Forecasting with LLMs
topic Machine Learning
url https://arxiv.org/abs/2602.12756